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ABSTRACT 

The 1981-82 external evaluation of the East Texas 
State University Elementary Secondary Eduation Act (ESEA) Title VII 
Bilingual Program is presented. This educational training program is 
designed to assist the State through the provision^ of well-prepared 
teachers, administrators, and specialists -to upgrade the teaching of 
Texas' bilingual students. Measurable objective's were stated for the 
projecJLJiis external evaluation, together with the reports from 
■internal monitoring, were designed to assure appropriate provision 
services and instruction to the participants. .This report includes 
approaches to the evaluation; program process^es; students m the 
program; student perceptions of the services;/ perceptions of 
instruction; report summary; and references . Evaluator resume, 
project forms and Boletin example are contained in the appendices. 
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THE EAST TEXAS STATE UNIVERSITY PROGRAM 



East Texas State University in conjunction with the Dallas Indepen- 
dent School District and others in the North Texas area, and with 
funds from the US Department of Educatiop and some especially desig- 
nated monies from the Texas Education Agency, plus budgeted items 
from the University itself, established a bilingual education program 
six years ago and has operated it since that time. The primary pur- 
pose of this training program is to assist the State through the 
provision of well prepared— t-earchers , - administrators , and specialists 
to upgrade the teaching of Texas' bilingual students. 

During the past several years, enormous gains have been registered 
in the provision of services to limited and non-English speaking pu- 
pils. Some students still do not' receive the necessary services, 
however, because the shortage of qualified teachers still persists. 
Indeed, the statistics on the latter problem, an insuf f icienct num- 
ber of ^ teachers, have not changed in recent years due" in part to 
the increases in the number of youngsters needing bilingual educa- 
tion and in part to the number of teachers that have left the pro- 
fession each year or who take jobs in other states.' 

The St/ate of Texas has a high proportion of Mexican Americans, other 
Spanidh' speakip^g populations , Native Americans, and recently, speak- 
ers orv-xiLti^ languages , notably Vietnamese . Too, the emphasis on 
teaching English as a Second Language, bqth as a separate subject 
and in conjunction with bilingual education, increased the training 
needs for the North Texas area.- The original anticipation, then, of 
a relatively short term training effort, was not borne out. While 
the number of Mexican Ainericans enrolled in universities has risen 
dramatically in Texas, the number' training to be bilingual education 
teachers leveled off before the needs were met. Nearly no Vietnamese 
speakers are enrolled in . teacher training programs in the State and 
few from other language groups expect to enter the field. 

Several' factors have contributed to the slow growth in the number of 
Spanish' .speaking teachers. Although most Mexican Americans are flu- 
ent in oral/aural Spanish, few of the older ' teachers and only recent- 
ly some of the younger people, have had the opportunity to become 
fully lit-erate in that language. Many high schools and most univer- 
sities offered Spanish courses but since their thrust was conversa- 
tion, few Mexican Americans enrolled. This lack reduced the pool of 
potential teachers from that group. Furthermore, as with all groups, 
only a limited number want to be teachers - they enroll in many dif- 
ferent academic programs. Too, even those who choose education as a 
career, do not necessarily want to teach" in elementary schools nor 
in bilingual education; many prefer to teach machematics , science, 
and the other fields . As with speakers of any' other language, in- 
dividual inclinations vary widely. 

Additionally, the salaries of .teachers in Texas have not kept pace 
with those .in many other fields and education's drawing power among 
Mexican Amer icans has de^areased. Higher , salaries elsewhere drain 
'Texas resources. And, finally, there is ^substantial proportion 
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of Mexican Americans that has not subscribed to bilingual education 
as a way to improve the education o£ their children. That, also, 
reduces the potential for Spanish/English bil ingual " education as a 
chosen teaching field. 

The East Texas State University ^ESEA Title VII Bilingual Education 
Program is a vital part of the necessary mobilization to meet the 
challenge, B-y providing not only the subject matter and education 
courses required, but additionally offering a strong program in the 
Spanish language, the University helps those already literate in 
the language, those who need only certain portions of it, or those 
who want to become fluent and literate. Further, with the popula- 
tion of Spanish speakers growing in the northern portion of the 
state, and with the economic status of many of them still low in 
comparison to some other groups, the tuition assistance part of 
the program has not diminished in importance. While Texas teacher 
salaries may not be very hig'h, that field still serves as one ave- 
nue for upward mobility while at ,the same time providing teachers* 
who can be trained for bilingual education duties and who, at the 
* same time, understand the needs of the youngsters they serve. The 
earlier federal aim of furnishing seed monies for the establishment 
of university programs was commendable and has produced important 
results. The g.dditional benefit, helping supply the training of 
bilingual teachers while at the same time assisting low income Mexi- 
can Americans and others/to enter the education field, should not 
yet be abandoned,' Tho need is still great. The continuing partici- 
pation of the federal and state governments, the school districts, 
and the University is vital to improvements in education. 



Program Ob j^ectives 

The program at East Texas State University was designed to increase 
the effectiveness of teachers and administrators in meeting the ^ 
needs of limited and non-Englis^h speaking pupils in the state, and 
especially in the northern part of the state. The programs at all 
three levels - jundergraduate, masters, and doctorate - first offer 
a strong preparatory program in the several kinds of subject matter 
to be taught, in the methods for general education, in the specific 
methods for bilingual education ,■ and in linguistics and the Spanish 
language. That is, the University is concerned that the partici-.. 
pants, for example, know mathematics' and how 'to teach mathematics 
in both English and Spanish. Bilingual and multicultural skills in 
counseling, administration , and other specializations are included. 
Expertise in working with parents and other community members of 
different cultures is an iiiiportant part of the* program. 

Further, the program was designed to help educational personnel meet 
the educational needs and other life skills of all children, to^ de- 
velop the special expertise to provide equal opportunity of access 
to children of limited and non-English speaking proficiency, and to 
help improve their performance within the educational , social, and 
economic syst^ems once they have gained entry. As a part of their 
education, the participants also experience bilingual education as^ 
they pursue their undergraduate and graduate degrees, thus increasing 
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thjeir awareness o£ the strengths and weaknesses, the promises and 
problems, of learning in two languages. The courses, the bilingual . 
environment, the utilization -of the teacheris * classroom experiences 
in the program, and frequent meet ings and other developmental work 
with professionals in education and members of the communities, were 
expected to help create a climate conducive to reaching the goals of 
this program. 

The program objectives were stited in behavioral terms, that 5s, 
the program was designed as competency based, to help the student's 
acquire the knowledge and skills/ needed in: 

• English a,nd Spanish 

• Mexican American and other cultures • 
. Bilingual teaching methodologies 

• Measurement* of student progress 

• Research methodology 

Special objectives related to counseling, administration,-sand other | 
school functions were also stated. In brief, the objectives spoke 
to the acquisition, improvement, and knowledge of languages and how 
to impart them and subject matter to children; to add knowledge of 
the socioeconomic and cultural realities of the US cultures, espe- 
cially Mexican American, and how these can affect children's learn- 
ing; to increase teachers' and other personnel's knowledge and sup- 
plement their knowledge and skills in research so they can profit 
more from publications and might, themselves, contribute to the bo4y 
of knowledge about Mexican Americans and bilingual education through 
' research.* 

Program Processes 

East Texas State UniveFsity incorporated a wide variety of academic 
resources into the program, utilizing the knowledge and expertise 
of many disciplines. English, Spanish linguistics , history, socio-' 
logy, anthropology, psychology, elementary education, and administra- 
tion were the sources of input. This necess i tated the cooperation 
of three colleges and several departments within the university, as 
well as the graduate division. The degree design and the course syl- 
labi were carefully prepared with the advice of the bilingual educa- 
. tion personnel of the Texas Education Agency, the Dallas Independent 
School District and other s nearby , and representatives of the poten- 
tial students, as well as of the communities they were to^ serve. \ 
Further modifications have been made as each successive year's ex- i 
periences were evaluated. New courses have been ^added as the need '1 
arose and others have been modified. (See the 1976-1977 through the .! 
19dO-I981 reports for the sequence of the changes.) *• 

Many courses have been offered at the school sites from which the 
participants came, helping to increase the reality based nature of 
the program. Field experiences were also provided for students not 
currently teaching in bilingual education. Resource persons from 
the Mexican American community, both general citizens and a number 



^ See original applicapipT} to the US Office of Education an^ the 
continuatio7t proposals to the US Department of Eduaation/ 
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of professionals, were brought into the planning process. East Texas 
.State University staff ^members with skills and experience in related 
ftpH f ^^^^"^^l^^^d- Staff vacancies were often filled with quali- 
fied Latin Americans, and othefs who spoke Spanish and/or have had - 
!^?MnrS?nt^ iS^"^^ education; these, too, were added to the con- 
sulting pool for the implementation of the program. The library has 
carried out a continual acquisition process of the needed materials 
for the research and course work. 

An essential ingredient" in the plan was the participation of the bi- 
lingual teachers in the presentations in the classes, whether brought 
.in as special resources or included as participants in the degree or 
certificate programs. The knowledge and skills they had gained, the 
materials they were using, and their general experiences Idded a sub- 
stantial dimension af practicality to the training efforts. This 
was especially important for the methods and materials courses of- 
fered by elementary ediication. Further, it was expected that the re- 
quirements of the courses, the materials they would deve .p ' in edu- 
cation language, and culture classes, as well as materials they 
would discover via the program generally, would add ' importantly to 
the conduct of bilingual and multicultural education in the schools. 

Just as important too, was the use of the Spanish language in the 
courses by both the professionals and the students. While there 
were some limitations to the oral/aural capabilities with Spanish in 
both groups each would be expected to strive for a continual in- 
crease m the amount of Spanish in the lectures, discussions, and 
written work m order to provide some of the bilingual environment 
and furnish opportunities for the acquisition of a professional grasp 
of the language. The University chose professors with the greatest 
cominand of Spanish while at the same time being specialists in thei 




-*^d'elds 

Liaison- services were also included in the process. Faculty with 
appointments that allowed monitoring of classes in which bilingual \ 
education was being" conducted, assisting schooll staffs, and consult-' 
mg with the student participants, were chosen ks the primary person- 
"^^/°^^^^^^^2sig™ent. Additionally, , the liaison personnel gath- 
ered information from the schools which ;^.^s then fed back into the 
program, thereby aiding the University in \^eeping itself current and 
effective. \^ 

Sites for Instruction' 

In keeping with its philosophy of taking the education to the most • 
appropriate setting, several instructional areas have been utilized 
The campus of East Texas State University, with its library holdings 
and professionals available, hosts a substantial number of courses . 
Simila:^ly the University Satellite Learning .Center in Dallas with 
specialized literature references and personnel, is important to the 
effort Courses are also held m differing schools in the Dallas 
Independent School District, and when appropriate, to buildings in 
MMLMnn'f''% The multiple facilities allow for the grea?Lt ?a- 
ci .itation for full time teachers and administrators, and' at the same 
time ensures the practicality of research resources , classroom access 
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for demonstrations, and the maximum transferability to the students 
who are campus based. While most of the campus courses for graduate 
students were taken during the summer sessions, some students were 
able to take evening courses at the University and increase their 
professi6nal contacts. 

The classes offered in the schools of the se^^eral districts have fa- 
cilitated work with the community organizations, especially those 
that were Mexican American, since the students were, in fact,, in the 
community. The arrangement also made it possible for a greater ex- 
change of information with bilingual education personnel, principals, 
and others interested in the teaching of limited and non-English 
speaking pupils. _ ' \ 

The East Texas State University Satellite Learning Center, with its 
expanded facilities for the library and .for ^the staff, continued as 
an important resource for the faculty, district personnel, and the 
^tudeuts / The extension of the ERIC and Lockheed search terminals 
to the center improved student and staff research capabilities. 

The problems of small school district^ are often quite different 
from those as large as, Dallas or Fort Worth. The inclusion of more 
of these in the program has materially' aided the provision of tech- 
nical assistance to the districts, thetir bilingual and English as a 
Second Language programs, and the general interaction between the 
faculty and staffs of the schools, a yiutually beneficial communica- 
tions network for the districts and for the University. 
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APPROACHES TO THE EVALUATION 

Three separate approaches were utilized in the evaluation of /the 
East Texas State__.University Title VII Bilingual Education Program: 
internal, external formative, and external summative*. The first, ^ 
internal, had two sources - the regular University evaluation acti- 
vities' and the monitoring of all work by the administration of the 
Title VII project. The second, formative by an external evaluator, 
was accomplished through an exit interview and an interim written re- 
port at the conclusion of each external monitoring. The third, sum- 
mative by an external evaluator, was primarily composed of the pre- 
sentation of the data and conclusions through the annual report. 

\ 

Internal j^valuation 

East Texas State University maintained strict acfcounting of student 
enrollment , fiscal management, anq faculty preparation for teaching 
the courses. The University was thus the most efficient source of 
information on these areas and , it furnished reports on them to the • 
funding source through its regular ' channels;.^ 

The supervisory functions of the deans of the colleges and of the 
, heads of departments , added ^ further dimens ions to the management of 
'the project. University wide commii^tees on curricula, cfo^^ses, and 
degrees contributed to the development of quality in th^ program. 
Faculty committees for the students seeking the undergraduate and 
graduate degrees, unique to each student or handled by an advisor, 
maintained an individual completioi^ and quality control , as well as 
contributing to the students' development in the profession.^ The 
Academic Vice President was directly charged with the supervision of 
all teaching/learning programs, thus involving the central admini- 
stration in the evaluation function. . 

Special advisory commi^ttees to the bilingual teacher trainin'g project' 
also were constituted, including members from appropriate university 
entities, the -Dallas Independent School District, students, and the 
community. These committees' functions in planning, assessment , -and 
revision of the program helped assure that the objectives were 
reached. 

The project staff also used a wide variety of consultants to aid in 
the several phases of the program. Representatives from the region- 
al education service centers, the Texas Edui^ation Agency, community 
organizations, faculty from other universities, and the US Department 
of Education, added further depth to the eva\luation. The con4;inuous 
input, through the liaison personnel, frop t^e aides, teachers, and 
administrators of the several schools and districts from which they 
came, also gav^ an internal formative evaluation dimension difficult 
to achieve in most university programs. The liaisons completed a 
standard form a'fter each monitoring or assistance visits to the 
schools, with the district administration, and\^when participating in- 
community activities. (See the form in Appendix B . > The information 
from these was integrated into the internal prdj ect reports at mid 
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SCHEMATUM OF THE PROJECT EVALUATION DESIGN 



Internal 



Sources : 

/ 

University Departiaents , 
Colleges, Central Ad- 
ministration ' i 

Coordinator , Bi]\ingual 
Education 

Director, Title VII 
ESEA Project 

External Evaluator 



Monitoring : 

Supervision of^"facult-y and 
students,, schedules, pro- 
grams , and syllabi 

Academic advising, anti review 
of student progress 

General management and fiscal 
control of project resources 

Feedback from monitoring 



External 



US Department p£ 
Education 

Dallas Independent 
School District and 
other participating 
districts 



Texas Education Agency 



External Evaluator 



Supervision of ptograiamatic 
and fiscal elements 

Recommendations on participants 
and programmatic aspects; 
feedback on student progress 
as they teach 

\ 

General supervision ojL\the 
cert if icatia^ program and 
course offeri^ngs 

Monitoring of all activities 
through observations,* inter- 
views, and docTjtment reviexvrs. 
evidenced in interim and fi- 
^nal reports and conferences 
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year and at the conclusion, o£ the year, thus they were not included 
in this external report. Further, the information from the other 
internal evaluation activities were embodied in the pro j ect ' s , re- 
ports and likewise were excluded from the present study. 



External Evaluation ^ 

In 1976, East Texas State University contracted with a private firm,. 
Development Associates with headquarters in Arlington, Virginia, and 
a branch office in San Antonio, Texas, to perform the external eva- 
luation. The company has xxmducted many local, regional, and nation- 
al surveys, needs assessments, and evaluation studies in the field 
of bilingual education. The agreement called for both formative and 
summative evaluation for the year 1976-1977. 

Dr. .Earl Jones, senior associate and bilingual education specialist, 
was assigned the major research tasks connected with the contract. 
His experience in bilingual education in Texas and Paraguay, and 
later in California and Guatemala, his proficiency in English and 
Spanish, his teaching, research, and administrative, roles in schools 
and universities, together with his service in evaluating a large 
number of Title VII and other- bilingual programs, gave him the wide 
perspective necessary for this project evaluation. (A curriculum 
vitae is included in Appendix A.) > 

The contract was renewed during the second year, 1977-1978. When 
Development Associates closed its Texas, of f ice an agreement was 
reached whereby Dr. Jones would continue the external evaluation 
with the East Texas State University program as an independent affi- 
liate with Development . Associates . Subsequently, Dr. Jones was 
transferred to the San Francisco, California, office of the company 
as director of the Study of California Services to Limited and non- 
English Speaking Students, funded by the California Legislature. The 
independent affiliate relationship was maintained for the East Texas 
State University ^ contract and the later formative aad siuninative 
activities were conducted under that arrangement. 

The funding for the formative and summative evaluation has always 
been severely limited. To maximize the utility of the activities, 
th^ifefore, the agreement called for the following tasks, each to 

serve bo-th functions: ^ -~- ^ 

. Monitor the graduate classes off^ered. , 

. Survey sample bilingual education" classes * taught by the 

participating students/ ^ 
..Seek information on the conduct of the progi^am from both 
disttict and University officiaTs. "^^^^ 
*. Study the ^^d'OGUment s related to the project; or emSii^-tjjig 

from jt* ' i / ^"^"-^^---^^ 

. Confer with the project personnel and teaching faculty on ^^"^^ 
the Implementation of the project. 
Recommend-ations were to be made to the project staff after each task, 
providin,g-"'£ofmiitive ijRformat ion for the improvement of the program. 
*Two. monitor ing,. schedules were provided and conducted, and both oral 
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and written interim reports we're siibmitted to the director of the 
project* Summaries of the findings were incorporated , when perti- 
nent, within this annual report. Some actions taken by the person- ^ 
nel or the University were als-o reported when they impacted directly 
on the conduct of the program ♦ 

As a result of the first evaluation tasks in 1977, including a study 
of the project documents and conferences with personnel, a more pre- 
cise investigation into the students' perceptions of the program was 
recommended The agreement was modified to include this facet. The 
instruments were then derived cooperatively by the evaluator, the 
project director, and the faculty advisory committee. The question- 
naires were administered, the data analyzed, and the results report- 
ed in each of the :^nnu^l reports and interimly to the director. 
(Details on the* instruments and the data analyses are described in 
later sections and the instruments are displayed in Appendix C.) 



Monitoring 

Funding permitted two sets of monitoring, one conducted early each 
project year ar^c^ another later on. In 1981-1982, the monitorings 
were carried out in December and in June. Regular class conduct 
was monitored during alternate observations of lecture, discussion, 
and other activities on both the home campus and at the Dallas site. 
Alternating the sessions allowed for sampling of each kind of acti- 
vity utilized in the class instruction while covering more o£ the 
classes in operation on the days of the monitor ^ng . Four courses^ ^ 
were studied .in December and six others in the early June period. 
Students' work was also examined and interviews vith students and 
professors were conducted at that same time to maximize the short 
time available. .. 

Additionally, a number of other activities of the project were moni- 
tored during the two periods: two specia'l seminars by outside con- , 
sultants, dinner and breakfast meetings of the students and faculty, 
a meeting of the project personnel with the Spanish professors, and 
a general student meting. Information gleaned from those activi- 
ties aided in providing useful input for/ the future of the program 
as well as gathering summative data. / 



Interviews am^-eonf erences 

An important part of the evaluation function was to interview the 
participants in^the various activities. During each monitor ing , 
interva'ews jv-et^held with the students, professors, community mem- - 
bers, administrators, and others involved in the work. These sup- 
plied information for the formative and summative evaluations but 
they were particularly useful in furnishing the explanations of the 
events that were observed. In addition, in the case of the students, 
the interviews gave an opportunity to assess their progress in Span- 
ish, English, and the subject matter fields. 

roject personnel facilitated appointments with the officials 
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primarily charged with the implementation o£ the program, both in 
the University and the districts. The latter were seen only briefly 
'in 198.1-1982 due to pressing" schedules • ^Questions to probe their 
commitment to the quality and continuation o.f the project were asked. 
Complete candor was apparently granted, sharing both the problems and 
the successes with the interviewer. Summary information obtained 
from the interviews and conferences was included in the appropriate 
sections of this report. 



Observations of Students* Classes 

A variety of classrooms taught by the students of . the project was 
observed, principally to assess the needs of the academic program 
rather than evaluate, per se, those classes, although disparities 
between the needs and the realizations contributed to the external 
assessment of the effects of the program. Information from those 
visits was used to make both interim recommendations to the project 
and to formulate long term impact conclusions for the University 
and the districts. 



Project Documentation 

The project proposal and its subs equent negotiated modifications , the 
interim reports- by the project personnel, and the continuation docu- 
ments, submitted to the US Department of Education, were provided for 
examination. Resource materials, research and class papers by stu- 
dents, correspondence with several agencies, and the project newslet- 
ter, JBoletxn, were also reviewed. Of special interest, a5 evidence 
of institutionalization, was the correspondence with pertinent admi- 
nistrators of the University, proposing and providing resources for 
the incorporation of the project as a regular University component. 
Evidence of faculty and student participation in professional acti- 
vities was also furnished. * 



The Student Perceptions Study 

As noted previously, an- examination of the internal evaluation plans 
and efforts, in addition to a review of the external evaluation 
agreement, showed that a gap in the design was that of the students* 
perceptions about the program and its components. A study of these 
was proposed and the draft questionnaires and opinionnaires were de- 
vised, reviewed by the project personnel and faculty, ^nd the final 
versions prepared. These were first administered in spring 19J7 and 
have been a continual feature of the evaluation since that time. 

The study was set up to provide interim data, via student opinions, 
on the conduct of courses, progress in Spanish, content or methods 
courses given and needed, sugge^stions for improving the program, and 
ratings of their degree design. Additionally, the instruments were 
prepared so they could be coded 'and analyzed through computer ser- 
vices. The analyses were performed at the computer center at Trinity 
University in San Antonio, Texas, the first two years and in a 
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s?nce ih^t ?^°^^^rTJ ^an Francisco (California) State University 
^ tiS ?97fi T^^""^ ^"'^ analysis setup were detailed i^ 

^n^Q nf"i?! e'"^P°'" .^""^ """^ repeated herein.) Versions 6, 8, 

and 9 of the statistical Package for the Social .Scien-es fNie et 
were used No names wfere used on the instrument^ bu^^he stSde^ts^ 
were asked to provide their social security numbers; when ?hese were 
included longitudinal tracking .6f changes in their ' percept ions was 
w^re^aTso don:?"'"' ^-gitudinal studies, including ^11 sLdenL! 

The instrumentation comprised three separate forms. The first nri- 
no^^^j;i'°^?5^ certain_ biographical/demographic data to be used as 
suits %tndp'r"'"''"? variables for analyzing the long term re- 
sults. Students were also asked tjo rate their proficiency in oral/ 
^--*u-Ta4--and^^^^ Spanish when they began the program. ?hat racing 

on Form A, supplied the basis for subsequent analyses of p?og?ess in 
Ir.l T^^^'- S r^q^^^ted suggestions for improving the p?o- 

gram and ,the individual^ courses ,. and obtained an update on thei? ^ 
Spanish proficiency. The opinionnaire , Form C, in keeping wUh the 
general University policy of student evaluatioA of cou?sef, gave the 
opportunity for rating the several design and conduct aspect! of the 

S^a^ish'„?^d°r'fi' °" a-'i estates of the'amount of 

Spanish used by the students and the professors in the courses. fAll 
three forms are included in Appendix C.) ^uuibeb. .(.ah 

During the first year, the questionnaires were handed out during one 
of the last class periods with an explanation of the purpose. The 
students were urged to participate. The professor then left the 

^l''^^.''^/ who wished to complete an instrument, volun- 
tarily did so, handed them to a student who sealed them into a 
^stamped envelope and mailed the package directly to the evaluator ' 
wnnVn^'"''" ^'''■'^^ neither the project staff nor the professor 

would see the completed instruments. ' Student s , were allowed to sub- 
?ipv^wfii;^J'°''Qi'''J^?''' including tl.eir social security numbers if 
they wished. Slightly more than 101 of them has left this blank / 
across the years. ^.j-aiix. , 



i ^ P^I^^^^P^tion was disappointing in some classes, to' 
tailing about 20^L,in one case and rising to about 801 in others./ 
l^tJ 't provided a list of the students and/was 

thoseUhat nad computed a questionnaire. BecausW of 
the relatively low rate of return, it was subsequently decided t/hat 
dvLlll ""tI. ^ deterrent to' responding; it was there^after 

tltVr Ji^ A ^?"P°!:^^ ^^te for the following quarter then rose/ dra- 
matically. Again, however, the, rate decreased to its lowest l?vel 
in the next quarter Consequently, students were also given tL op- 

."'^i^-K^' questionnaire themselves. Professors were also 
reminded to distribute the forms since .dnterviews showed that some 
had neglected to do so. An increase w^s then experienced but'the 
return rates have varied considerably>across the years since then. 

l^tllnll^lli^^^^^^ -ceived by the 

the largest^.since"he'2va?uatiof began. """"'"'^ ^"^" ■'^ > 

o ^ 
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; As will be seen in the tables reporting the results of the analyses, .. 

; the N sizes were small for some courses and some sessions. In some 
courses pthe number of students was quite small, especially those 
related to research and the individual projects, appropriate to the 
nature of that type of work. Absenteeism no doubt also accounted 
for some of the losses. The voluntary aspect also reduced tiie num- 
ber sent in. Because o.f these circumstances, there was no necessary 
relationship between the number of respondents listed in the tables 
of this report and the enrollment in the courses* The small numbers 
weakened this portion of the study but could not have been avoided 
without prejudicing the rights of privacy of the students. 

To ascertain whether the low response rate for some courses biased 
the calculated replies, an examination of them was conducted. The 
study showed that excluding those with only one or two forms, no 
necessary relationship existed between the number of respondents and 
the ratings; that is, students submitted instruments with low, med- 
ium, and high ratings in all but four courses. In those, no weak or 
very weak ratings M'ere checked and only four fair- replies were regis- 
tered for all of the different course components • In two of the, four 
only strong and very strong ratings were given. In othor courses, 
however, and often involving the same students, some very low ratings 
were assigned. Interviews with some students were also conducted to 
examine the possibilities of biases and no direct relationships ap- 
peared. Some students who did not submit evaluations stated they 
simply did not do so; tHeir stated ratings would have included the 
complete range of , ratings offered. It is believed, therefore, that 
no substantial bias^v,.enter ed the ratings when three or more students 
completed the forms. 

The instruments, as received via the mail by the evaluator , wer e 
/ then coded and keypunched for statistical analysis. The codings 

I ' were 100% verified, the analyses performed, and the appropriate tab- 
I les for the report were prepared. The computer cards for all the 

f years to date'were subsequently committed to magnetic tape for use 

in future longitudinal analyses. 

Two kinds of data were transmitted to the project. The general in- 
. formation included in the tables in this report, plus the discussions 
with the director, was the first and most important to the formative 
evaluation. Professors were given the opportunity to request private 
data on their individual courses but only two did so. This annual 
report, including some analyses across the six years, was also to 
^ be tendered to the project director for the use of the University, 

the Bilingual Education Program, and the US Department of Education. 
The specific course designations are not disclosed within this re- 
port to protect the instructors. / 

/ '* 

Limitations to the Evaluation 

Despite the several sources of information and the broad coverage of 
the design, one obvious weakness remained without investigation: the 
impact of the program on improving the teaching abilities of the stu- 
dents such that their pupils learned more. Stated more succinctly, 
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as a question, did the children in the 'classrooms of the students 
learn more because their teachers were participating in this project 
and degree program? The difficulties of such measurement are myriad 
and even controversial. The subject should not be avoided, however, 
simply because measurement is difficult and because the project 
lacked the funds and other resources to carry out such a study. Se- 
rious thought to providing at least some tentative conclusions should 
be given and some resources should be provided by the US Department 
of Education or other entities, to conduct this important research. 

Finally, the funding provided for external evaluation was small and 
the "invest igXt ions , therefore, were necessarily brief, even in some 
cases cursory\ The repoi't must be taken within that limitat^ion. 
Despite this handicap, a great deal of useful information was fur- 
nished throughout the study and that information help/ed the Univer- 
sity and the ^project improve the program and its services. The ex- 
ternal evaluator knows of no events or processes that were not scru- 
tinized and th'erefore submits this report with confidence in the 
findings unless\ otherwise stated. 
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' PROGRAM PROCESSES 



East Texas State "University his operated the ESEA Title VII Bilingual 
Program for six years. In the first year, development occupied a 
large part of the administrative time and the program was begun at a 
highly functional rate. S&veral important changes were made during 
the year to strengthen both\ the participant 'benefits and the manage- 
ment capability so that still further improvements could be made in , 
the future , \ - ^ 

During the second year, the [major processes were associated with the, 
consolidation of management,! enhancing .the resources and service'^s 
available to the participants and faculty, and the extension of the 
work to include a larger number of agencies and community institu-\^ 
tio.ns. The early cooperation with the Dallas Independent School Di^^- 
trict was continued and the McKinley Independent School District wa^ 
added. East Texas State University membership in the Federation Bi- 
lingual Training Resource Center increased the^ resources available 
to the Title VII program and in return, the University contributed 
experience based knowledge to the management of the Federation ope- 
rations . An augmented thrust the second y:ear was the strengthening 
of the ^work with the Mexican American community, especially in the'' 
principal target area, Dallas , both by including that segment of the 
population in the management /aspects of the program and in providing 
leadership enhancement services to its members. 

In the third year', with the /processes then principally at a routine 
level, the program further ^consolidated its service offerings and 
management systems, continued its work with the North Texas Federa- 
tion and the community, and expanded its service area .i^ito new dis- 
tricts: Diocese of Dallas, Irving, Garland, Piano, EnHis , Mesquite,. 
Mt. Pleasant, Paris, Tulia, and New Braunf els . Students were dra\m 
from an even larger area while the participation f ram ^Dallas was in- 
creased. From the beginning, relations with the Texas Education 
Agency, the educational service centers, and other universities in 
the area were improved. One new element in the program was meetings 
with Native American' groups to explore ways to\serve that community 
component. Another addition was that of offerimg courses in Teach- , 
ing English as a Second Language in conj unction\ with the Texas Edu- 
cation Agency. This \^as a valuable adjunct to the program and ^ of 
inestimable assistance to the districts since li^ttle training in that 
field had been available previously. _ 

The fourth year showed further consolidation and expansion of the^ 
program. The courses were updated and additional materials were in- 
cluded as they became available. Permission- to grant a doctorate^ 
was sought and granted, and the federal funds- for a few;^ scholarships 
for^ that level were obtained. Specialist programs beyoiM the' masters 
degree were also inaugurated. The number of undergraduate students 
was increased and the masters program Continued to grow. Beginning 
efforts t<^ provide assistance to other language groups, notably Viet- 
namese, were studied. The University/Texas Education Agency offer- 
ings in Teaching English as a Second Language were continued. Funds 
for the leade-trship development work with the Mexican American and 
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other community constituencies were not granted. for this year but 
a part of that loss was taken up by student participants that car- 
ried out the work voluntarily. The North Texas Federation service 
activities were also discontinued; the several universities encom- 
pdsed a part of the work within their regular .programs but the loss 
of the considerable resources was significant. 

During the fifth project year, East Texas State University was able 
to increase the participating students even though many colleges 
were experiencing substantial decreases. Further , more^ and more 
students were being attracted to- the program from other* parts of ■ ' 
the state, from other areas of the- US, and from Mexico . A bilin- 
gual science educator was added to the faculty. Management changes 
were needed, also, to relieve the enormous burden that was shoulder- 
ed by the two administrators and the University was able to. modify 
its staffing to improve the condition. The library continued its 
acquisitions and the Satellite Learning Center obtained a much lar- 
ger holding of bilingual reference materials, as well as provide 
more space for the staff. 

The sixth program year gave more emphasis to the undergraduate in- 
stead of the graduate levels ; the undergraduates enrolled in great- 
er numbers and there was some decrease in graduates. An endorsement 
plan to add English as a Second Language to the teaching certificate- 
was approved and begun in operation. Several changes in the up-g-ei 
echelon of University administration were made and the new officaVs 
were oriented to the bilingual program. 

Administration • - i ■ 

A major strength of the East Texas State Universiti'.'Title VII program 
was the dedicated early leadership of the directo-^^. and assis tan t;- ' di- 
rector . .Their experience through the first four years allow.ed a'^ 
. careful transition from^ a beginning effort to one that operated with 
professional expertise. Their incorporation into the regular. Uni- 
versity faculty furthered the^ program institutionalization and' im- 
provement , 

The administrators had, in addition to the Title VII program duties, 
many regular faculty obligations. Recognizing the inequities in 
the demands \ on their time, the University reorganized some of the 
activities, \separating the directorship of the Title VII program 
from the coordination of the general bilingual instructional efforts, 
creating two\different positions. That organization continued dur- 
ing the sixth\ year and the separation allowed each to .devote more 
time to the specifics of the assigned responsibilities.^ j 

The cooperation among the project, the departments, and the colleges 
not only continued but was increased, even though some of the persons 
occupying the administrative positions changed. A part of that con- 
tinuance was the addition of personnel that knew about and supported 
bilingual education. The administration helped provide an environ- 
ment in which the project could flourish'. The Title VII program was 
/seen as an integral part of .the University.' 
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The project director and bilingual program coordinator occupied new 
• quarters early in the year t;kat greatly enhanced the space and made 
communications with the departments in the College of Education much 
more complete. The capability of handling student affairs more pri- 
vately was a major advantage of the new offices. 

Changes in state laws and regulations necessitated their study and 
sometin\es their incorporation into the teaching or management within 
the program. Often these resulted in increased contacts with dis- 
tricts and communications • with new ones. In the long run, the addi- 
tional work involved has benefitted the program. Amendments to the 
legislation governing the- ESEA Title projects err impinging upon 

them were enacted or are under consideration. They naturally entail 
preparation by the project staff so, that whether affecting districts 
or the University, they can be inco'rporat ed with a minimum of dis- 
traction from the primary function, that of preparing highly quali- 
fied teachers, administrators / and specialist staff members • The 
project paid close atcention to the proposed changes and managed 
them well when they v/ere enacted into law. . , , 

Inter-Agency Cooperation 

,The University Title VII program cooperated fully with the Federation 
Training Resource Center during its existence. The University conti- 
nued to cooperate with the North Texas universities in all matters 
of" interest to. bilingual education. Similarly, the University per- 
'Sonnel aided with many activities of the Mexican ,.%ierican community, 
both to help in the development of the community and as an expression 
of its support. The ciirco de Mayo, and Nat ional Hispanic Week activi- 
ties were enhanced by tHe participation of the fapulty members. 

In addition, and as a/part of its own community, the program coopera- 
ted with the campus organization, Asoclaclon Cultural de' Hlspano% 
Americanos y in'' helping publicize the or gani zat ion and its activities . 
This was a natural extension of the program since it enhanced the 
academic input through assistance from members of .that organization. 

As previously noted, the program was considering how it could assist 
bilingual . Vietnamese/English education. Native Americans, too, met 
-"'with University and program officials for ways to improve the educa- 
tion for that group. Some ass is tance' to German and Czech speaking 
groups was given. 

Also discussed in another section, the program cooperated with the 
Texas Education Agency in offering specific training in the Teaching 
of English as a Second Language. Rapidly . increasing in importance, 
this training represented an advance in the work of the University. 
Further, bil ingual education • students in other universities in North 
xTexas participated in the courses with full transfer rights to their 
degree programs. Such cooperation helped augment the resources of 
each one when not enough students for courses in every university 
w^er e warrant ed • . Program help was also given to the Tfexas Association, 
for Bilingual Education. 
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Institutionalization 



East Texas State University continued to support the ESEA Title VII program and 
to incorporate it directly into the regular structure of the University. The 
previously noted office space and division of adrninistrative responsibilities 
are cases in point. In addition, special evidence of institutionalization was 
decnonstrated in: 

. All the teaching positions were held by tenure track staff except one 
an(^ discussions for resolving t±iat renmning problem were under;<^ay; 

. The undergraduate and graduate endorsement requirements for teaching 
I English as a Second Language were proposed by the faculty and approved 

by the Texas Education Agency ; . ' 

. All other certificate and degree programs were formalized and appeared 
in the undergraduate and graduate catalogs; 

. Library holdings in,.]?ilingual. education and related fields were sub- 
stantially expanded on the home campus and the Satellite Learning 
Center. 

.vlhe faculty strength in delivering a part of the instruction in t±iat language 
^t^^ined at a high level, not only in the bilingual education staff but also in 
several other departments t±iat contribute to the instruction. 

^^The bilingual education coordinator and the external evaluator met with the new 
^President of the, University shortly after he assxjmed his duties to present an 
overview of the previous years of work, the results of the evaluations, and the 
strengths and areas needing iirprovement . Ihe Dean of the College of Education 
continued in strong support of the program. Ihe new Gradiiate Dean and the new 
Academic Vice President had already X\orked with the bilingual education faculty 
and their continuing support was assured. „ 

All of the interviews with the University officials produced expressions of 
their concerns and comnitment . The desire to fully incorporate the program com- 
pletely into the University structure reireined undiminished, even though the I 
full realization of that aim could not be totally accoriplished . Ihe University 
has, however, institutionalized the ESEA Title VII program into its regular 
structure vlxStb than any other known by the evaliaator. 

J Ihe evaluator would like to anphasize the irrportance of this aspect of the East 
Texas State -University approach to the Title VII project since he also works 
'With other university training programs. It. has been relatively easy for some 
universities to grant special status to a federal program, ^ exempting it from the 
usual control and administrative mechanisms. The projects have almost^ always 
suffered later. Cessation of the grant, dif f iculties , with degrees and/ or credits 
permanent faculty appointment omissions, and similar problems ^ve often resulted 
iri'the disappearance or substantial reduction in the university -offerings and 
services. While obviously East Texas State University needed federal support - 
six years was a relatively short time to iciplecnent -a program t±Lat was a new field 
' - and especially vAien the increased demands for bilingual teachers were still evi- 
dent, there was; undeniable evidence of the incorporation of .this program into 
the regular offerings and structure of East Texas State University. It was a 
clear case of federal monies well invested for the future. Additionally, the law 
income level of .many of the particip^ts justified the aid from, tuition assis- 
tance . 
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Teaching Faculty 

The University and the project continued to make important moves in 
improving the capability to deliver bilingual teacher training. In 
addition to the appointments cited in previous reports , several^de- 
partments have added faculty with demonstrated ability to work in 
bilingual education and the necessary related fields. The Universi- 
ty has an unusual' strength in that field and in teaching English as 
a Second Language. 

The University was also able to reduce its dependence upon adjunct 
faculty. Such faculty members, even when chosen with a great deal 
of care, do not always produce the highest amount of student learn- 
ing. Consequently, the additional strength within the University 
faculty was particularly laudable. 

The University faculty was observed. to work hard in making the pro- 
gram a success^ closely following the degree design specified for 
bilingual education,. The students perceived some weaknesses and 
those are detaired, in a later chapter. Some part of the weaknes's 
was due to the 'fi^eld itself - the relatively small amount of objec- 
tive research relating implementation to studen't performance.^ Some 
progress, was noted in this regard: the study for the California Le- 
gislature; a 'series of articles in the leading Teacher and the AERA 
Journal; plus ' evaluations of small projects described in the ERIC 
entries. The faculty was aware of the new materials and were in- 
corporating them into their instruction.' 

Another source of the complaints voiced in the interviews w^s the 
many non-program courses taken by the undergraduate ' s tudents , who 
were in the majority in 1981-1982. Students criticized poor pre- 
paration for. some classes , dwelling on inconsequential material, 
and in a few cases, insufficient attention to their needs. While 
no university condones these problems, the number of complaints 
was probably no greater than had the students of other programs 
been queried. 

Most importantly to. the long tenn view of the tea.ching, the number 
and- severity of the complaints about the quality of instruction m 
the graduat^^ courses decreased markedly. The renovation of the syl- 
labi and the' last year's coordination of material across courses had 
largely eliminated' the source of some graduate criticism. 

Unfortunately, one area remained problemmatic for the undergraduates 
that of the Spanish instruction. It must be noted, however, that 
some improvement in the ratings occurred, chiefly because one pro- 
fessor not previously included, was judged by the students to in- 
struct well. The. complaints registered in previous years about the 
denigration of Mexican American Spanish and about courses taught 
mostly in English, continued for two of the professors. The matter 
was again brought to the attention of the administration and re- 
views were promised. It must be emphasized that the graduate courr. 
ses in Spanish were rated very high and almost no comments refi^ulted. 
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The discussion o£ these problems is necessary but it should not be 
taken as a condemnation o£ the. teaching within the program. To tl>e 
contrary, the student ratings b£ the courses and the obseryed con- 
tent coverage and teaching me thods showed exemplary professor capa- 
bilities in most of them, ^*Tough but thorough'^ was a typical expla- 
nation for a professor that from the beginning has always had high 
ratings, ^'Demands a lot of work but teaches well," "knows bilingual 
education techniques and shows us. how they should be conducted," and 
"it wasn't an English course but my writing improved because he de- 
manded it" were other important responses, "I learned research in 
that course that wasn't even on research" was a complement any pro- 
fessor should be happy to merit. In summary, then, the majority of 
the professors in the program taught what they should and did it . 
well. No program could ask for more - except to insist that all pro- 
fessors do that, : 

The amount of Spanish used in the classes has not increased much over 
the years. In some classes, 99%' was conducted in that language; in 
others, nearly none. Several factors contributed to the differences. 
In some classes, there were so many monolingual English speakers that 
the professor would have been in error if he had conducted the class- 
es in Spanish, Some prof essors , of course, did not speak fluent 
Spanish but most of these at least tried to use what they knew. One 
important technique observed in one course was that the professor, 
limited in Spanish, provided the necessary vocabulary for the content 
by writing the words on the board and obtaining help from Spanish . 
speaking students in explaining them. Still another, who understood 
a great deal of Spanish but could not speak well, insisted that the 
Spanish speaking members of the class respond in Spanish,. That, too, 
was a perfectly acceptable technique. In general, then, and consi- 
dering the several factors, the amount of Spanish utilized in the 
courses was probably at about the level it could be. If the enroll- 
ment were h-igher, special Spanish sections could be formed but under 
the present circumstances, the various efforts to use that language 
were commendable, / 

The evaluator has had many opportunities to become well acquainted 
with some of the students who, because of/ necessary part time work, 
•still remain. Two ardas of improvement in oral Spanish have been 
noted in them: they used Spanish more ai^d.they made fewer errors. 
The increas ed. vocabulary of the Spanish/ speaking Mexican Americans 
was notable, VocabulaTy and pronuncicTtion by the non-Mexican/Latin 
Americans improved. Students were al^o producing more project work' 
in Spanish and that work was more accurate, * Spelling improved, more 
diacritical marks were included, and the grammatical construction 
showed a better grasp_ of the language. An examin nti m nf some p1f>-.^_ 
mentar v teaching ^-fir^Tects > for exainple, revealed few errors and even 
fewer clumsy phrasings. The writing in Spanish definitely increased 
and Improved, 

The general teaching practices 'bf the faculty also improved, Qnly one 
professor was reported late or absent without warning; few students 
said a professor had come to class unprepared. The observed instruc- 
tion showed preparation and dominance of the subject matter. While 
it may seem to an outsider that these would be expected in university 
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work, the reality in many university ^courses is less than desirable 
performance... East Texas State University definitely improved its 
teaching in the classes associated with the bilingual education 
program. 

Not content with the present status in teaching, the project has 
continued its faculty development program with even more attention 
to instruction. Several seminars were held, both on the content 
of bilingual .education and related topics, as well as on -the metho- 
dologies for delivering them. Too, the University produced a stu- 
dent evaluation of the instruction and it was instituted during 
this year. While spme professors were dissatisfied with the new 
system> the institutional pressure to improve instruction remained 
strong, as evidenced by the adoption of the evaluation. 

Prof ess ionalizat ion 

ITie intensive duties of the staff in combination with the work in the 
project and in regular departmental functions demonstrated an un- 
usual commitment. . It also restricted some activities that might 
lead' to greater prof essionalization Nevertheless, the faculty 
members found time to work on some research, consult with other 
univer^' ' ties and some districts, and conduct evaluations. The fa- 
culty contiriued to show its concern for professional development. 

In the process of adopting a certificate endorsement for English 
as a Second Language, the Texas Education Agency requested input 
from several sources. The project staff participated in one held 
by universities with bilingual education departments, presenting 
a provisional plan for a degree and for a certificate. The State 
evolved a tentative set of courses and East Texas State University 
was one of those asked to provide suggestions on it. Additionally, 
a special English as a Second Language subcommittee of the bilin- 
gual educatidn committee drafted a ^i^roppsed plan for East Texas 
State University and it was accepted^' almost in its entirety, making 
it possible for some students to begin work on the endorsement al- 
most immediately. 

The faculty -persisted in its work with the Texas Association for 
Bilingual Education, the TESOL group, and the Association of Teach- 
ers of Foreign Languages. Even though no funds were available for 
some meetings, faculty members paid their own way to participate. 

A strong interest in professional reading was manifested in several 
faculty contacts. Some cited recent articles and research reports, 
commented on evaluauions and new meaburemenL jJLuuedures, and in 
other ways ' demonstrated a good grasp of what was new in bilingual 
education. Faculty use of the two data retrieval systems was evi- 
denced. The use of the many bilingual materials housed in the cur- 
riculum library, the main library, and the Satellite Learning Cen- 
*ter was high.. The library continued to respond to student and fa- 
culty needs by increasing the holdings. A notable production was 
an annotated bibliography' on bilingual . legislation and court cases 
produced by one of the librarians . . * 
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The project news organ, Boletin, also serves as an important com- 
munications effort, and in a very wide context: students, profes,- 
sors, teachers, and administrators. The presentation of materials 
about new legislation, recent research, and views about bilirt^ual 
education help a great deal in keeping the audiences uptodate on 
vital topics. Summaries of locally produced .surveys, graduate re- 
search., and evaluations underway furnish additional information. 

Articles in area newspapers, radio and television programs , and di- '; 
rect letter communications were also maintained high in 1981-1982. 
These were .s^en as of increased importance since the restricted 
funds for the^lTews .organ reduced the number of issues. The campus 
newspaper aided materially in keeping the students and faculty in- 
formed. Each increases prof essionalization of the audiences. 

Graduate student research, produced primarily in partial fulfil Iment 
of the requirements in the research methods course, continued to 
show -improvement. The publications search, treatment o£ the mater- 
ials, and clear distinction between, the reporting and conclusions 
sections, were major advances. Although sometimes seen as a minor 
•aspect of such work at the masters level, the excellent mechanical 
preparation added much to the professional appearance of the papers. 
The faculty members and the students are to be congratulated on the 
quality of the work. And the added benefits of publication and pre- 
sentation at conferences, thereby imparting the knowledge to others, 
further demonstrated the degree of importance held by the project 
regarding prof ess i-onal ization . 

^ Community Involvement 

Although Title VII no longer funded the direct community involvement 
activities of. the bilingual program at East Texas State University, 
the previous work was conducted so well that many continuing efforts 
could still be noted. Community lead^ers trained in earlier years 
remained active, promoting specific benefits for their communities 
as well as improving bilingual education.) Faculty members, former 
■students, and currently enrolled students were still contributing 
their skills to community development. Parental assistance with 
many activities in the schools with bilingual education remained 
quitfe high. The important work begun through the project was stiil 
• paying dividends . 

A second kind of involvement, that of the teaching community, was 
evidenced throughout the 1981-1982 project year. Teachers and ^d- 
ministr-a tors from the school dibUlc.ts we re in cl uded in the advisory 
committee to the project; they were used as resources for the work 
and contributed a great deal to the formulation of the general po- 
licies and the conduct of the program. They were not seen as "ob- 
jects of the program," as is often the case, but as integral coope- 
rators in a design and delivery system. 

■ Still another important evidence of the project's concern" for the. 
inclusion of the teachers and administrators into the project was 
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the work of the liaison personnel. Every staff member was seen as 
a part of that system to provide services to, and at the same time 
gather information on heeds from, the district personnel. Special 
liaasoiji work was assigned as a part of some faculty members^ work 
to ensure- timely delivery of services to the schools and to the 
s.tudents , Regular visits were made to the schools, with advance 
notice and. ass i-st:ajrce was giv^n when requested. Further, reports 
on„the monitoring of classes and on the assistance rendered provi- 
ded ^a feedback to the project so it could improve. 

The student evaluations of the liaison services have been more and 
more fav6rable through the project years. (A longitudinal report 
is included in a later section.) Some of this positive increase, 
of coursa, was due to the augmented capacity of the project to de- 
liver this kind of service. The ratings also showed, however, that 
the teachers and administrators recognized that the University and 
the project could provide special ized services to bilingual educa- 
tion in their schools. , , • 

Other e^^nce of ttie recognition of the willingness and ability 
of the/East Texas State University Title VII project to help with 
educational problems was that of the increased number of cooperat- 
ing .school districts. As new laws and regulations were promulgated, 
more^arid jnore districts called on the project to assist with compli- 
ance./ Some districts have begun the planning and implementation of 
bilingual programs with the advice and counsel of pro j ect personnel , 
have -urged their teachers to participate in the credent ialing 
courses, and have ifiade contributions to the work of the program. 
All pf these, even those of only early formation, denoted acceptance 
of the* Title VII project And its concern for involvement between the 
University and the ^distr ict s . 

While there are many positive sections to this . evaluation report, 
prob.ab'ly no phase of the East Texas State University project reached 
the high degree of realization as that of prof essionalization. The 
author has evaluated university programs in Texas, Arizona, and 
California and has never found the superior quality evidenced at 
East Texas -State University* The project was well integrated into 
the University, the school districts, and the communities. This 
commendable element in the project should be disseminated to other 
university projects and the personnel should be asked to* assist 
others in achieving such a high degree of cooperation. Much of - the 
proje^ct 's success ^in other endeavors within its program was directly 
relat-'c'd to'its commitment to, prof essionalization - to its competence 
in the delivery of services to every part of its community. 



Communications 

The ccmmuhica^ions efforts were evident from all the explanations in 
the previous sections: of this report, but they bear repeating for 
emphasis. The pro j ect worked hard at maintaining a dialogue with 
all its audiences: state • agencies , other universities, its own uni- 
versity components," the districts, trhe Mexican American commifnity, 
and the students. It actively provided information and sought in- 
formation frqjn them. 
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The staff obtained information about bilingual education and disse- 
minated it to the affected audiences. It fostered and encouraged 
research and provided the findings in summary form. It interacted 
with the several components of the communities and reported the in- 
formation as feedback. It is important to note that this was not 
constrained to "positive" information - negative input was also 
communicated. Special attention is called to several articles and 
editorials in Boletin and the specialized conferences conducted on 
campus that presented both the favorable and unfavorable aspects of 
or attributed to bilingual education. This free interchange was a 
vital part of the communications network. Unless negative feelings 
can be discovered and aired, and suitab;Le , replies given, bilingual 
education will continue in its "half life" existence of grudging 
acceptance because it's the law. The ' evaluator commends the staff 
on its open communications. 

The) willingness; of the project staff to meet with any of its commu- 
nities and discuss the work, bilingual education, community needs, 
arta any other item of interest was one of its major characteristics. 
Many professionals, especially university faculty, act as if they 
feel they are the ultimate experts in their work and that interac- 
tion is either unnecessary or undesirable. A perusal of the excerpts 
of the many communications appended to this and the previous annual 
reports will show that this was not the case of the Title VII pro- 
gram staff. 

The East Texas State University faculty generally, and the members 
of the bilingual education staff particularly, are to be commended 
for their work in keeping all segments of the community 'in communi- 
cation with each other. Continual efforts to keep these • communica- 
tions open and frequent have resulted in a much higher level of 
professionalization, which in turn, has resulted in a more effective 
training program. 

- " Resource Facilities 

The project was especially cognizant of the need to provide a wide 
range of resource materials for the use of the faculty and students. 
While few Title VII funds were used in this acquisition, the project 
stimulated" the collection of many materials and the accumulated re- 
sources were unusually large for such a short , period. These, of 
course, must be continually updated but the ]i981-1.9S2 status of the 
collections was excellent. 

The campus library has been a major force in providing the resource 
materials. Primarily utilizing ^ts own funds , this University com- 
ponent collected together one of the best- sets of materials yet exa- 
mined by the evaluator. The collection was not only commendable for 
its mat'erials on bilingual education but also on linguistics, Span- 
ish, English, history, sociology, psychology, anthropology, and many 
other related fields. A part of the credit for this collection also 
was due to the faculty who examined the literature in their fields 
and suggested those that would be appropo as resources for bilingual 
education. / 
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Some special curriculum materials have been purchased with Title VII 
funds over the years and these were housed in the project office and 
in the offices of the professors responsible for teaching the parti- 
cular subjects. These were particularly important since so many spe- 
cial needs arise in bilingual education; the development efforts of 
others should be made available to the teachers and students and 
they were not only present but utilized in the University courses so 
-that students became acquainted with them. 

East Texas State University also maintained a study center in Dallas 
and it, too, housed some materials pertinent to the work of the pro- 
ject. That site facilitated the use of the materials by the part 
time students who worked all day and had fewer opportunities, except 
in the summer, to study on campus. The space in the study center 
was seriously crowded in past years but t.he move to new space sub- 
stantially resolved the problem. 

The professors who taught in the Dallas sites also carried great 
amounts of books and curriculum sets with them, further increasing 
the exposure of the students to the special materials. Those in- 
cluded curriculum resources for elementary and secondary classrooms, 
texts, supplementary materials, and audio visual aids. Some of the 
audio visual materials were also sent to the study center in Dallas 
to further aid the teachers in studying them. 

The University also -^consolidated some resources that were not easily 
accessible to the students into a new learning center on campus, A 
system of carrels facilitated the study of materials on filmstrips, 
cassettes, multimedia kits, tapes, and records. Materials in many 
languages were thus made accessible and the Spanish and bilingual 
Spanish/English holdings were especially impressive. The consoli- 
dated system in one locale should encourage the use of the materials , 

The Dallas Independent School District also maintained a considerable 
prof essional ' 1 ibrary and the students had access to it. Thus the co- 
operation between the two institutions increased the resources of 
both. The members of thie North Texas. Federation - Texas Christian 
University, Southern Methodist Univer s ity , ' the University of Dallas, 
Texas Women^s University, and North Texas State University, as 
well as East Texas State University - allowed students access to 
their library holdings. This was a mutually profitable cooDerative 
function since it substantially increased the resources available to 
any one 'of the members. . 

Summary of the Process Variables 

The external evaluator spent a great deal of time monitoring the en- 
tire process of the project in order to provide both written sugges- 
tions for improvement, through the interim reports, the conferences 
with the project and University administrators and teaching faculty, 
students, and district staff members. While the brief personal con- 
tacts restricted the information that could be gathered and imparted, 
planning the work carefully appeared to give adequate coverage and 
the conclusions about the process should be useful. 
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The administration had gone to unusual lengths to incorporate the 
project work into the regular University structure. While it had 
not yet been able to manage all of the institutionalization that 
was planned, primarily because of financial constraints, it had 
achieved far more than any of the other Title VII university pro- 
jects the evaluator had studied. The inter-agency cooperation was 
high, especially with the participating school districts. Coopera- 
tion with the Texas Education Agency, particularly evident from 
the joint offering of the English as a Se~cond Language courses and 
the move into the endorsement program for that subject, was^strong. 
East Texas State University cooperation with other univers ities , 
especially those in the North Texas Federation, was excellent. Mu- 
tual assistance between the University and s^ome of the education 
service centers, and Educational Dissemination and Assessment 
Center in Dallas, was very fruitful. 

Despite some major changes in the University administration, the 
project did not lose its support. The new officers took time to 
become acquainted with the work, the staff, and the evaluations. 
The cooperation of the Dean of Education 'remained exemplary. 

The thrust toward faculty development was very evident and the em- 
phasis on the new field, English as a Second Language, further in- 
creased East Texas State University's capability. Evidence of add- 
ed prof ess ionalizatibfl-'^'by the faculty and students was ^strong . 
The communications process was kept at a high level ev^n though the 
funds for. the news organ were reduced. Community involvement, des- 
pite withdrawal of funds for that purpose, was well developed with- 
in the University, with the districts and their teachers, and with 
the Mexican American community in the target areas. The collection 
of resources was excellent and the distance problem was alleviated 
by a Dallas collection and transportation systeiiji by the professors. 

V 

Even though r;oting some areas in which more improvement could be 
effected, the evaluator found only one area that had been only 
partially remedied, that of the undergraduate Spanish instruction. 
The new offices and the reduced load on the administrators was par- 
ticularly helpful to the smboth operation of the project. 

In summary. East Texas' ^State University and the ESEA Title VII Bi- 
lingual Program had made substantial strides toward the best pos- 
sible delivery of services to the students, the districts, and 
ultimately to the limited English speaking childi^en in the State. 
The officials of both are congratulated for their persistent ef- 
forts toward their goals. 
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THE STUDENTS IN THE PROGRAM 

East Texas State University conducted a needs assessment on the 
training required in the North Texas area at the beginning o£ its 
program. Utilizing the data available from the Texas Education 
Agency, published research, and surveys in the immediate geographic 
region, it was evident that the deficiencies in all levels of re- 
sources to conduct bilingual education were critical. The Mexican 
American population was growing very rapidly in the Dallas and Fort 
Worth areas; moderate increases were noted in the smaller popula- 
tion centers throughout the North Texas portion of the state"^ 

The first -thrust, and still, the largest in terms of numbers, was- the 
provision of bilingual education methods and techniques to already • 
certified teachers in elementary schools . Two options were avail- 
able: the courses needed for the endorsement to the elementary cer- 
tificate and a full masters degree program in bilingual education. 
As soon as this .program was stabilized, the University then planned 
and negotiated approved programs for undergraduates so they could 
enter the bilingual education field directly; a specialist program 
beyond tlie masters degree was needed that would equip experienced 
personnel to aid the administration and, teachers in the implementa- 
tion of bilingual education; and the doctorate in education, which 
would proTide both specializations and at the same time furnish 
high level personnel for other functional positions in universities, 
agencies, and' local administrations. 

All four levels were direly needed throughout ' the North Texas area 
and the nation. Increases in the number of pupils that could bene- 
fit from bilingual education and programs, to serve them, have kept, 
the demand high. The four programs are still needed if the students 
in' elementary and secondary schools are to be educated within an en- 
vironment that will facilitate their abilities to enter, profit from, 
and contribute to the educational, social, political, and economic 
life of the state and the nation. - .\ 



Program Participants 

The majority of the East Texas State University Title VII partici-, 
pants came from the Dallas Independent School District, which co- 
operated directly with the program. Many others, howeVer, came from 
other districts in the North Texas area, and recentl/, from all over 
Texas. 

In the early years, almost all the part icipants were teachers in tl;ie 
first four grades of school since that was the emphasis for bilin-' 
gual certification. Since that time, the numbers of participants 
from the other grades an^d from other positions in the schools have 
increased markedly, demonstrating an attraction to the East Texas 
State University program. That change is significant since several 
universities in the area offer some levels of training for bilingual 
education. The 1981-1982 undergraduate emphasis would augment the 
already existing supplies of teachers. 
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The University guarantees the privacy of information, therefore, 
the reporting on the several characteristics studied is voluntary. 
Too, many students part;icipating in the courses are not assisted 
financially. The two factors mean that the percentages cited in 
the accompanying tables do not necessarily translate into the 
numbers officially registered as ESEA Title VII participants. 

The wide variety of occupations of the reporting participants is 
displayed in Table 1. The changes across the years represent dif- 
fering emphases in the schools on the provision -of bilingual educa- 
tion and the group receiving special assistance from the project. 



•Table 1 : * Comparative Frequencies *'o'f Reporting Participants by Oc- 
cupation from 1976 to 1982 



Occupation 


1976 

^7o 


1977 


1978 
7o 


1979 
7o 


1980^ 
% 


1981 
7o 


1982 
7o 


Teacher-: 
















Kindergarten 


10 


12 


12 


14 


12 


4 


3 


•Grades 1-3 


46 


47 


48 


43 


30 


27 


22 


Grades 4-6 


. 13 


13 


14 


4 


15 


12 


. 9 


Grades 7-8 


4 


2 


4 


8 


3 


8 ■ 


6 


Grades 9-12 


3 


1 


■ 4 


7 


7 


6 


5 


Aide 










6 


8 


5 


Volunteer 


0 


0 


0 , 


0 


1 


2 


1 


Administrator 


2 


2 


3 


. 6 


6 


2 


3 


Computer /Media 


0 


0 


0 


0 


2 


2 


0 


Curriculum Writer 


1 


2 


2 


2 


4 


2 


1 


Resource Teacher 


1 


1 


2 


2 


4 


0 


1 


Student /unemployed 


■>v 




/% 




6 


18 


42 


Unspecified other 


15 


13 


11 


24 


1 


4 


1 


No response 


1 


9 


o.-. 


0 


0 


4 


2 


Between the 1979 and 


19 80 reports ^ 


the 


computer 


program was 


ex- 



panded to account for. these specifications formerly grouped un- 
der ''other, " 

The principal target area was the Dallas system; as the teachers in 
the system gained their credentials and/or masters degrees, some 
decreases were e^p.acted. However, these were partially offset by 
the inclusion of other area districts. The doctoral program also 
raised the number of participants from some professional categories. 
The large increase in students that were unemployed mostly resulted i 
from first their inclusion in the program and the later emphasis on 
J assistance to them. ■ \ - 

The total and bilingual teaching experience of the students in the 
first few years was fairly stable. As many of the experienced in- 
structors completed their certificates and degrees, the total ex- 
perience diminished. The bilingual experience, on the other hand, 
continued to rise until 1982, when the higher proportion of under-- 
graduates diluted that experience. The 1979 through the 1982 data 
are presented in Table 2. o 
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Table 2: QoTnparati\^e Frequencies of the Total and Bilingual Teach- 
ing Experience of the Participants: 1>979-1982 



Experience Categories 



None 

Less than 9 months 
One to two years 
Three to five years 
Six to ten years 
Eleven years and more 
No Response 





Total • 






Bilingual 




Q 7 Q 

VIZ) 


1980 


1981 


1982 


1979 


1980 


1981 


1982 


/o 


% 


% 


% 
10 


% 

10 


% 


% 


% 


4 


4 


12 


39 


8 


6 


22 


44 


8 


6 


16 


14 


29 


21 


29 


19 


18 


11 ' 


16 


11 


22 


11 


16 


14 


29 


'39 


14 


11 


25 


38 


14 


5 


18 


20 


14 


8 


10 


12 


4 


7 


23 


20 


16 


8 


6 


12 


2 


2 


0 


0 


10 


3 


0 


0 


0 


9 



The previously noted undergraduate students increased the none ca- 
tegory considerably, both in total and bilingual experience. The 
It must be emphasized that although the percentages of the more 
experienced teachers have declined, their numbers', and the imme- 
diate benefit to the classrooms in the sc^iools , are still very 
great. Too, many of these upper teaching experience participants 
are ip positions of considerable influence, increasing their uti- 
lity, to the bilingual education program as a whole in the districts 
and in the State. 

Change also occurred in the mare and female portions of the student 
■population. The percentage of males decreased slightly from 1980 
to 1981 bi^'t recovered in 1982. 

Table 3: Male and Female Proportions among the 
Student Population 



Sex 


1979 
% 


1980 


1981 
7o 


1982 
% 


Male 


12 


19 


16 


18 


Female 


88 


. 81 


84 


82 



Ethnicity changed a great deal in 1981 and some of that difference 
remained in 1982." In all the earlier years , Mexican Americans had 
made up more than half the group . In the latter years , the number 
of Mexican Americans, an'd their percentage, decreased while the 
other Latin Amer-icans and the Anglos increased. It should be noted, 
however, that some Mexican Americans that speak little or no Spanish 
classified themselves in the "Anglo and other" grouping. 

The proportion of the students that already held the , bilingual en- 
dorsement grew very rapidly from 1977 through 1980. In 1981 , _how-_ 
ever, the percentage dropped dramatically from the previous high 
of 64% to' 26%. Many of the 1981 students were new to the ..program 
'and had not yet had time to complete the certificate courses; the 
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Table 4: Reported Ethnicity Frequencies: 1979-1982 



Ethnicity 


\ T Q 7 Q 


j.y o u 
% 


T Q R 1 


1 Q R 9 
o Z 


Mexican American 


53 


■ 55 ■ 


37 


43 


Other Latin American 




7 


8 


10 


Blaiiik 


2 


0 


2 


1 


American Indian 


0 


0 


2 


2 


Anglo and. other 


45 


38 


52 


44 


These were- subsumed 


under Anglo and other until 



high percentage of new undergraduate students in the 1982 project 
year further influenced the pr:oportion, dropping it to 247o. 

Six years' of examining student characteristics has found important 
differences. The early years of being one of the first university 
programs to make the certificate and the masters' degree in bilingual 
education available, attracted a large number of persons already in 
that field but who needed the credential and/or the.^ degree. Later, 
Anglos and other groups were attracted to the program and thus some 
decline in the percentages though not in the numbers, of Mexican 
Americans occurred. Similarly, the heavy emphasis on the under- 
graduate program in 1981 and 1982 further changed some of the per- 
centages, reducing the experience and the proportion already hold- 
ing the certificate. 

The changes are ^een as responding to the most immediate needs of 
the North Te^^as audience. The increases in children in the bilin- 
gual and English as a Second Language classes still require that 
some experienced teachers return for additional work. The Spe- 
cialists, too, are in demand. The University was able, however, 
to concentrate on the undergraduates and it did so. successfully 
in the last two years of the program. 



Detelopmext Associates, inc. 

29 



STUDENT PERCEPTIONS. OF THE SERVICES 

Many universities have begun programs for bilingual education; some 
of them have experienced little or no growth* One of the problems 
has been a restrictive set of course offerings that did not appeal 
to the students. Still another' has been offerings by professors 
who were unprepared in bilingual education or who continually dwelt 
on philosophical issues or personal campaigns of one sort or another 
but who did not progress to a high degree of technical -teacher pre- 
paration. N^one of these condi t ions has p-ruduced attractive programs 
to a large number of students. 

To help assure that both the program and the courses met the stu- 
dents' needs, the East Texas State University Title VII project set 
up a close monitoring system, utilizing both expert judgment about 
the courses and the way they were taught, and student perceptions 
of the program as a whole and its parts. As each set of course ob- 
servations was completed, oral and written interim reports were sub- 
mitted so that the project administrators had the opportunity to 
talk with the instructors, giving helpful suggestions for improve- 
ment. In addition, the observor offered private, individual con- 
ferences to any professor that so requested, again to offer sugges- 
tions.' Further, the students rated each course and the rating/ forms 
were sent to the evaluator. The results were summarized, sent to 
the administration, and offered to any professor that desired the 
information on his specific course. 

The present document, because of the anonymity requirements, does 
not identify professors or courses; these were discussed as they 
related to the Title VII project's attempts to produce the best 
possible environment for learning. Reiterating from the methodology^ 
section, the student evaluations were voluntary, thus some courses 
received few ^ratings ♦ Also, some courses in students' programs were 
not exclusively for bilingual education and one or only a few stu- 
dents mijjht be enrolled in them. This reduced the statistical in- . 
ferences that could be made from the ratings. The discussions in 
this chapter will be concerned principally, then, with those courses 
*for which three or more forms were returned. The narrative sugges- 
tions, however, were- ut il iz ed for the entire range of. courses in 
which the reporting s tudents were enroll ed . 

General Perceptions 

The students were asked to rate the general program in which they 
were enrolled plus thisir fluency in Spanish. In addition to one 
poijnt in time assessments, their ratings were examined across the 
years they were enrolled, giving both a tross sectional and a longi- 
tudinal analysis of these two peneral elements. 

The first element, the de^jree design, /Was examined in the present 
report in two ways. .First, the ratings by all students reporting 
each year were compared across the l^st four years (Most in 1981 
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and many in 1982 were just beginning their programs under the pro- 
ject and few chose to judge them at that point. • This was parti- 
^cularly true for the undergraduates, many of whom were in their 
•first two university y'eavs .) See Table 5. 

Although the no' response category grew in its percent of. the. total 
reporting, the ratings actually given on the degree design remained 
at the strong level, approximately 4 out of a possible range between 
1 and 5. The increased capacity of the faculty to attend students, 
both on the home campus and in the Satellite Learning Center , may 
have accounted for the continued strength.. The additjional exper- 
ience of the faculty with the existing degree plans yio doubt added 
quality to their counseling. ^ ly 

'I 

Table 5: Rating. Frequencies and Calculated. Com- 
' posite Ratings on Degree Desi/gn 



Rating Category" 


1978 

■ % 


1979 
7o 


1980 
% 


1981 
7o 


1982 
% 


Very strong 


10 


6 


^1 


14 


16 


Strong 


47 


53 




41 


41 


Fair 


39 


30 


27 


16 


8 


Weak 


1 


2 


1 


■ 2 


0 


Very Weak 


1 


0 


/ 0 


0 


0 


No Response 


•2 


10 


3 


27 


35 


Composite Rating 


3.62 


3.72 3 

/ 

i — 


.88 


3.91 


4.08 



^ Very strong-5^ strong-4 ^ fair^S^ weak=2^ very 
weak=l; no response was excluded from the cal- [' 
culations for the composite rating. 

Since a high. "proportion of the students had been in the program a-! 
year or less, the remaining cells were sometimes vacant, making a 
strong statistical test for significance tenuous. Clearly, the 
difference between 1978 and 1982 was significant at • the .001 level, 
a decidedly positive factor for the development of the advising fa- 
culty. . ^ 

One general effect postulated by the program designers was the in- 
creased Spanish fluency of the students. Specific Spanish courses 
were offered. and the utilization of Spanish within the other classes 
was also expected to have a salutary- effect on fluency, as well as 
literacy. Students rated their fluency, oral and written, at the 
beginning of their, programs -at East Texas State University and every 
year thereafter. Nearly no changes in fluency in Spanish were re- 
gistered between 1977 and 1978 but less than a year of learning 
time had elapsed. The following year, 1979, showed much higher 
ratings. -Since then, the students have entered the program as 
ot'hers were graduating and the fluency ratings have not changed 
as much as might be expected; tjiey prove to be a mathematical func- 
tion of the entry/exit rather than fluency. In checking only those 
students ' that have been in the^project courses for two or more 



ERLC 



DETELOP.ME.VT ASSOCIATES, INC. 



31 



3b 



years, the 1981 group showed the most marked progress in written 
Spanish of any since the beginning of the program. Almost 80% be- 
gan the program with a very Low rating, in written Spanish and judged 
their- end of program status Go be fairly fluent or very fluent. An 
important aspect to this increased writing ability, according to 
the comments of the respondents , was the graduate course in Spanish 
grammar, introduced during that period. 

The 1982 group with two or more years in the program showed similar 
results; every student increased his rating at least one point on 
the scale and seven elevated the mark two points. Again, the com- 
merits centered on the. grammar course, noting that they ^'now under- 
stand structure .much more." Interestingly, too, two from other 
Latin American countries volunteered thatAthey. thought they were 
very fluent at the beginning but they learned' so much in the course 
that they would change their beginning assessment. It must Ije no- 
ted, too, that the graduate Spanish courses all enjoyed very high 
ratings and many students discussed the overall quality of the 
Spanish program as instrumental in their progress . The undergra- 
duates , however, did not change their fluency ratings, in two years, 
apparently a. function in keeping with their substantial criticisms 
of the courses . • 

Although potentially general in its ef f ects , the clinical assis- 
tance/liaison program was also included as a. possible individual 
student influence. Since much of the help is to schools rather 
than individuals, some students had no opportunity to .observe the 
work; this was particularly true for the undergraduates who were, 
of course, not in a school setting. The no response category has 
always been large through the years but it was especially so in 
1982, a reflection of the increased proportion of undergraduates. 
Nevertheless, those who rated the liaison activities found them as 
-fairly effective, a reasonable rating for the contact they had. 
Table 6 shows^ the separate category percentages and a comparison 
across time shows the judgments to have remained quite stable 
across the last four years. 



Table 6: Frequencies and 
ceptions of the 
vices r 1979-1982 


Composite Ratings of Stii 
Clinical Assistance/Liai 


dent 
son 


Per- 
Ser- 


Scale Categories'^ 


1979 
7 

V h 


1980 

7° 


1981 
7o 


1982 
7o 


Very effective 
Fairly effective 
Not effective 


16 
13 
4 


20 

27 . 


16 
4 
0 


17 
10 
0 


No opportunity to observe 
No response 


,38 
29 


31 
16 ■ 


25 
55 


44 
29 




Composite, rating 


1.4 


1.3 


1.3 


1.4 





cry effeotive = 2j fairly ef f ective-l ; not eff ective-0 . 
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Few' evaluator observations of the liaison services were conducted 
in 1982 due to the press of other evaluation tasks. In those that 
were seen, the assist^nc^ appeared to be appropriate for the occa- - 
sion and they were certainly well received. 

The consultant part of the project was conducted both in Dallas and 
on the Commerce campus. In each instance, therefpre-, attendance 
for igome students was difficult and impossible f or^rthers . Provid- 
ing conferences in both sites, however, was important to reaching 
a greater number of the participants. Nevertheless, as seen in 
Table 7, th^e no opportunity /'no response grouping' remained large. 



TabYe 7: Frequencies and Composite Ratings of Participant 

Perceptions of the Consultant Component.: 1979-1982 

/ 1 



Scale Categories* 


1979 
% 


198C 
% 


I 

\ /o 
\ 


1982 
% 


Very useful 
Fairly useful 
Not useful 


29 

33 

6 


25 
34 
6 


\23 


31 
28 
5 


\No opportunity /no response 


32 


31 




36 




l^omposite rating 


1.3 


1.3 


1 . 4\ 


1.5 , 


■ ■ 



^ 7 eru useful = 2j fairly useful=l; not useful=0 . No re^sponse 
was not utilized in the composite calculations. 



An important point in the consultant component was that . a higher 
percentage of the students attended in 198^^ than in 19817 The un- 
dergraduates -attended at about the same r^te as the graduates. A 
sizable segment of the students commented^ on one particular con- 
ference made available to them through thte^ Desegregation Project 
of East Texas State University; they were very impressed with the 
content and the delivery style of the speaker. All of the comments 
about any- consultant were positive. The combined utilization of 
conferences sponsored by the Title VII and the Desegregation pro- 
jects, those by special campus groups, and the general University 
bureau brought a wide range of topics and views to the students and 
that was ■ appreciated by them. 

Overview of the Services 

The major service components haye generally been judged at about a 
fair rating across the years. In 1982, the students' degree designs 
were judged strong and numerically higher than previously. Spanish 
fluency raised' about like other years except that written fluency 
.was quite high, a rating that had first appeared in 1981. The li-^ 
aison service continued at a level judged fair "plus^' and • the ^,cdn- 
sultant conferences were at about the same level. ■ The inclusion 
of larger numbers of un-dergraduates modified only the Spanish flu- 
ency ratings. 

-_ Developmext Associates^ inc. 
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PERCEPTIONS OF THE INSTRUCTION 

The East Texas State University Title VII project has emphasized the 
improvement in the delivery of its services to the students. The 
provision of materials, professors experienced- in bilingual educa- 
tion, and assistance to those professors was "expect ed to create a 
teaching/ learning environment that would maximize the participant 
benefits from this most important portion of the program. Greater 
learning by the students, who are the teachers and specialists in 
the districts, would then benefit the pupils in those districts by 
increasing their learning. 

University systems are such that a special project cannot demand 
changes in the way the courses are taught; it can o-nly offer assis- 
tance and suggestions so that those who want to improve can do so. 
Individual professors are jealous of their courses and sometimes 
resist .modifications that might make their work more acceptable to 
stud'-ents, reasoning that their subject matter is more important 
than what the students think. Too, circumstances do not always per-' 
mit a University the ideal choice for an instructor in a particular 
course. East Texas State University has continually worked toward 
the long range goal of improved teaching, both by offering assis- 
tance and by choosing the best personnel it can find. 

Some subjects, however, are less v/ell received in and of themselves 
and these tend to receive less favorable evaluations from students. 
Subjects that are totally new to the students, ones that require an 
unusual amount of outside study,* and those- that are more theoreti- 
cal than practical are among the less favored materials. Addition- 
ally, not all student s ' perceive the conduct of a course alike. Va-' 
riations in their perspectives , their preparation, and their inten- 
tions when they signed up for a course all contribute to differen- 
tials in the "ratings given. 

Nevertheless, the University insists that student perceived infor- 
mation about the courses is a valuable input to the improvement of 
the project services. The six year experience of the evaluator 
with this program demonstrated that such is the case. Each year 
several professors have .requested private information about their . 
course ratings, have discussed the student perceived deficiencies 
and strengths with the evaluator, and have subsequently modified the 
offerings such that their ratings have improved. 

Tw6 types of information were gathered about the courses: one was the 
ratings on the courses and the instructional components of them\ The 
ratings provided direct measurement for the evaluation and benchmarks 
against which the professors could strive for improvement. The se- 
cond type was suggestions from the students on how to improve the 
courses. These wer > important adjuncts to the scale values (very 
strong, strong, fair, weak, very weak^ on a Likert scale of 1 to 5 
(a reversed polarity) , which allows for statistical analyses of the 
results. The suggestions for improvement and the general comments 
about courses are usually not quantified s,ince their voluntary ^ 
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inclusion does not necessarily indicate the number of students hold-- 
ing that opinion. 

In a few instances, a comment or suggestion will be so pervasive 
that the proportidji o£ students indicating it is provided, either 
because the number \was small and therefore might not represent the 
ideas of the group, \or when the number was large and thus demonstra- 
ted a general percep'tion. The anonymity of the professors was guar- 
anteed'and that sometVmes cau'sed comments to be deleted from' the re- 
port since their inclii.sion would point directly to one instructor. 
When a suggestion w^as j5ositive, posing no threat to the professor,: 
it was incorporated even though identification might be possible. 

Program Design 

Each student was asked to comment on or offer suggestions about how 
the general design of the program could be enhanced. Across the 
four years, these *have decreased consid^erably , apparently r.^flect- 
ing the higher positive ratings given the courses during that-timel. 
That is, it appeared that in most cases when -students were satisfied 
•with the courses, they felt less inclined to write out general com- 
ments. That is not absolute, however, since two conditions .i'n 1979- 
1980 caused them to include substantial narrative information, as 
will be shown. The positive comments were repeated in 1981 and 1982 

First, two less than positive conditions were commented on exten- 
sively. Over the years, but in lesser quantities each year, the 
students have expected that the professors would use more Spanish 
in the conduct of the classes. As discussed in a previous section, 
the amount of Spanish that could be used was in part, dictated by 
the proficiency of. the professor and in part that of the students. 
The suggestions did note differences but still indicated their own 
concerns for greater fluency in Spanish and the recognition that 
its utilization in the classes could help them improve. 

The second type of comment was that engendered by perceived improper 
conduct of a course. The students might be generally satisfied with 
•their pru^i'^am but regard a particular course as needing improvement. 
While some of these were discussed earlier, the most important ones 
are reiterated here for emphasis:, 

. Students expected thaft Spanish would be the dominant language 
in a Spanish course; they objected strenuously when one under- 
graduate course was taught primarily in English. 

. Both Mexican Americans and non-Mexican Americans objected to 
disparaging remarks made ^bout Mexican Americans and/or about 
their Spanish. 

. Criticisms about several undergraduate, non-program courses 
were frequent; the gif^ading system was criticized in four of 
the courses . 

. The graduate courses, especially those on Spanish, enjoyed 
very favorable comments. " - 
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These fdndings were relayed to the . adminis trat ion o£ the project and 
to those prbfessorsvyth^' requested private inforitiat ion on their own 
"coursres. The project and University, administrations were aware of 
most of these problems • and w'ere .seeking ways to alleviate them. At 
least ane professor made a determined effort to improve the delivery 
of the courses between the fall^and spring sessions and the spring 
comments showed some success in this regard. 

The t-positive comments, mentioned earlier, far out weighed those that 
were^. less favorable. In fact, most courses received a considerable 
number of notes about th.e amount of learning, the excellent informa- 
^on that had been imparted, knd the methods used in teaching them. 

^AnatteT~lc lrrd~or-5iig g es t ion em^arrale d fronr. ^a—l^ &-i~eours e-^ d ded-tc^ tke , 
program. All the students but one in that bourse took the time to 
writ^ a Substantial narrative about it, praising the professor, the 
proj^5C:t, and the inclusion of the course in ^phe design. As an illus- 
trat^idh of the strength of the offering, th^following excerpts from 
the/ comments are presented": *V 

...this course should b^ a prerequisite , to be. taken before 
the^ other bilingual courses... 

...this course should be offered at the beginning of the 
Masters program. 

■I le.arned more about writing^and improving my Spanish fluency 
^ in this course than in any I have ever taken. 

.\is to be congratulated for the finest course ever presented 
\. in this or any cither pro'gram in which I hav^ been enrolled. 

Now I want - more ; a>f ollowup^^^ or courses on Spanish gram- 

ma^ and composTyxii^ improve this program. 

These are especially important flidgments since the students ^^ere by. 
no means talking about an easy course. Included in their comments 
were phrases such as "...toughest course ever..." "...hard pr.ofessor 
but knows her business and how-^to t e a cji-^trr: " "worked harder on 
this .course than all the rest ' cdmbined . " The only negative comments, 
and those were still tempered by praise for the ^course and the pro- 
fessor, came from students who felt that their, level of prof iciency 
in Spanis'h" caused them some difficulties. 

?Nearry" every student suggested i^hat the course be offered very early 
(or first) in the program. It wi)uld appear to the evaluator, how- 
ever j that some -Study of the case shcfuld precede such ^ move. A 
g6'od many of the students in^ this course were not very^ proficient in 
S^panish when fehey began their work at East Texas State University. 
No doubt some could have taken the qourse almost immediately but some 
would have had many difficulties and perhaps not have learned as much 
as they did at this later time. If ther^ were eriough students, the 
best might be to offer a section early to -students very fluent in . 
Spanish and then another later on for those that need to improve 
their .fluency first , * --^^ 
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The 1982 comments on this course were the same or similar to those 
■in 1981. An interesting occurrence, because it was the first in 
the six years, was that- one Mexican American responded totally in 
Spanish. Her comments on the course are > worth noting: 

...y por^rimera vez, despuls de hablar espanol toda mi 
vida, entiendo el porqu§ de las reglas de composici6n y ) 
ortografia. Ahora, si, puedo explicarlas a mis estudiantes . 

**After speaking Spanish all my life, I now for the first time under- 
$tand the^ rules and can explain them to my students.^' Since bAli- 
teracy has been found to be associated with high achievement scores , 
improvements she may now be able to make in her instruction are! very 
likely to bear • results . 



Ratings of the Courses 

The increase in the number' of undergraduate students in the 1981- 
1982 program has had many effects on the evaluation items ; many 
have 'already been noted. The most dramatic, however, is in the 
number of courses for which evaluations were available. In the 
early years of the project, .10 to 14 were rated. In 1980-:r981, • 
20 were included. ' THe ^1981-1982 ratings comprised 81 courses. 
And, o-f course, the number of fields covered was also greatly in- 
creased. 

This plethora of listings makes it difficult to characterize the 
instruction in a comprehensible way. The details , cours e by course 
and factor by factor, were made available in the interim reports to 
the ^"aixrector of the project; their repetition herein would add no- 
thing /to the evaluation. Instead, the subjects "are grouped by ma- 
jor catner^ory , distinctive elements within them, and according to 
the level jof the instruction: lower division, upper division, and 
graduate. The means, then, for each subject by level were calcu- 
lated across ^e^ courses comprised. 



Particular caution must be exercised in viewing 
number of students reporting on some courses was 
No information is available on how other student 
might have rated them. The information is impor 
dents' point of view but should not be generaliz 
enrolled in the course's. 

Table 8 contains the summary ''irTformation on the 
by the participants . ^ Note first that the rating 
for this section: 1-very strong to 5=very weak. \ 
observation is the unusually high quality of the 
the subjects. Almost all of them cluster around 
all but three cases (marked with '''0 the mean wa 
tative of the mean for the separate courses. 



the results . - The 
often one or two . 
s in the courses 
tant from the stu- 
ed to include all 



subjects reported 
scale is reversed 
The most important 
vast majority of 
s trong . Too , in 
s closely/represen- 



Equally important is to observe the ratings on the so-called "hard" 
subjects such, as mathematics and science; they range from strong to 
very strong. The graduate courses were also uniformly rated very 
high*> That is noteworthy because 1982 was the first year in which 
that 'happened. v v 
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Table 8: Mean Ratings of the Subject Areas, Subjects, and Levels 
of the Reporting Participants in 1981-1982 



Area/Subject No. No. Overall Ratings'^ 

Courses Students- Lower Div. Upper Div. Graduate 



Languages : 












English 


10 


14 


1.8 


1.9 


- 


Spanish 


16^ 


57 


3 . 1** 


3.6 


1.2 


French 


2 


3 


_ 


2.3 


- 


German 


2 


2 


1.5 


^ — 


- 


Education: 












-Eirem6Hr£-ar-3^ 


-4-2-^-- 


66 




2^-0 . 


-1.6 


Other 


2 


7 , 






1.6 


Social Sciences : 












History 


5 ' 


11 


2.5 


1.4 


1.3 


Political Science 


6 


6 


2.5 






Sociology 


4 


7 


3.0 


1.3 




Anthropology 


. ,1 


3 




: 2.0 




Psychology- 


4 


9 


1.5 


2 . 5^^''^- 





Math/ Science : 
Mathematics 
Biology . 
Eartih Science 
Geography 



4 
2 

1 

1 



0 th 



i2rs : 



BuslLness 
Speech 
Linguistics 
Phy 



7 
3 
1 

2 



1.8 
1.5 

1.0 



2.0 



\ 


1 


2.0 




2 


4 


2.0 




2 


7 




3.3 


4 


4 


2 . 7** 




.• l^vevy 


s trong ; 


2=s trong ; 


3= fair 



very weak. - ^ 

^^'The mean masks some that were very high and some very low in 
this group. 



isolating those subject 
years was a somewhat di 
some of them . The tes t 
sets of program courses 
ate set as a whole, .and 
cally. It must be emph 
could not change much ( 
^^lack of improvement'* i 




s that had been ^evalUated across the six 
fficult task because the numbers changed on 
s for statistical significance showed two 
to have significantly improved: the gradu- 
the elementary education courses specif i~ 
asized, however, that some of the others 
graduate Spanish is an example), therefore, 
s not a mark against them. 



In general, then, the students perceived the courses and the way^ 
they were taught as a positive factor in their ''development . Their 
positive ratings of both subject matter and teacher preparation 
courses were important since both are necessary for effective 
teachers. The ESEA Title VII project and the University are to be 
congratulated. - © 
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REPORT SUMMARY 

i 

The 1981-1982 ESEA Title VII Bilingual Education proj eje^t at East 
Texas State University was operated on funds from the/University, 
the US Department of Education, and : some monies from/ the Texas Edu- 
cation Agency for specific courses. ; Emphasis this .-^ear was on the 
undergraduate level, but some mas ters,> specialist y and doctoral 

as-sistance was granted. y 

/ 

The \program ' s goals sought the eahancement of learning and "educa- . ;' 
tional opportunities for all children; they specifically were aimed' 
at those with limited English ^peaking proficiency. The means to 
those ends was the preparation of high qu ality bilingu al teacher s, 
■t~eacBer~s"'oF"EhgTisT^^ a Secoiid Language , specialists in those snh- 
jects and the support fields/,* and administrators capable of manag- 1 
ing such programs . Measurable obj ectives were stated for the pro-| 
ject and this external evaluation, together with the reports from 
internal monitoring, were designed to assure the appropriate pro- 
vision of the services and the instruction to the participants. It 
was expected that success in the project ^s objectives would aid in 
better learning by the University students and then transmitted to 
the children of the service. area, that of North Texas, and thus • ^. 
contribute to progress across the nation. • 

The evaluation was comprised of both formative and' summativB as- 
pects to furnish immediate feedback to the administration while 
modifications could still be effected, and subsequently, an over-; 
all assessment of the conduct and the results of the project. Do- 
cument reviews, interviews, observations, questionnaires, and opi- 
nionnaires were the' principal methods utilized to obtain the data. 
Activities on the Commerce campus and at the Satellite Learning 
Center, in Dallas were monitored twice during the year. 

The project began in^ cooperation with the Dallas schools but since 
progressed to ten others. Cooperation with other universities, with 
education service centers, and dissemination and assessment 'centers' 
was active. Unusually strong inueractions were chronicled with the 
Texas Education Agency. Internally, the pro j ect* works well with . 
the departments and the colleges ; a campus wide committee is active 
in advising th3. direction of the activities. Major changes among 
the University administrative personnel did not diminish the thx^ust 
of the program. ^ 

Courses are offered in several settings for the convenience of the 
students and to enhance the practicality of the offerings: the home 
campus, the Dallas center, and in schools of the participating dis- 
tricts. The-main campus library has an impressive holding of bi- 
lingual and related subject materials for study; the Dallas center 
expanded its materials considerably in 1982. Professors transport 
large amounts of materials with them when they teach in other . sites, 
thus facilitating the study of the students in those places. The 
administration, divided this year between a project director and 
bilingual program coordinator, was able to manage the services ne- 
cessary for the several sites efficiently. 

* *** 
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The communibations about bilingual education and other topics of 
interest to the several audiences remained at a high level during 
this, year. The University newspaper, the faculty newsletter, and 
the project organ, Boletin, provided excellent internal cx)verage. 
Articles in area newspapers, on the radio, and in television pro- 
grams further expanded the network. 

', ' ' 

The major seirvices to the students and the districts continued al- 
though .some in less intensity because of withdrawqil or reductions 
of fu:i;ids . The liaison work^ was rated similar to previous years; 
the consultant conferences somewhat higher than before. The degree 
design function raised considerably and that was a significant rise 
when compared to the first year of operation. Community involve- 
ment was still active but a little less than when funds for that 
component allowed for more intensive efforts . 

The University demonstrated its continuing commitment to the projec 
through furnishing greatly expanded and more efficient office space 
The already mentioned division of duties for the administrators fur 
ther denoted institutionalization. All courses, ^ degrees, and cer- 
tificates had been incorporated into the regular program. Only one 
faculty member had riot yet been placed on tenure track status; the 
problem was' being discussed byt resolution had not^ yet o.ccurred.. 
Prof essionalization of the .faculty and the students .was very high'; 
all faculty he'ld doctorates , had training and experience in bilin- 
^al educati^ or the ^app^r^^^ related topics , and continued, to 

progress in their competencies. (Student work was substantially in- 
creased in fluency, notably in' wtl\tten Spanish that had been low. 
Student research work", both for \:h6t research course and for the 
doctorate, was very good. ' \^ 

The heart of the project, the instruction of the students, was ra- 
ted high by the expert observor and by the* student participants. 
While a few courses were still posing problems, particularly in un- 
dergraduate 'Spanish , most had significantly improved across. the 
years. It was important, too, that the students rated the subject 
matter and the teaching preparation courses, on the whole, as well 
delivered. Graduate courses generally, mathematics and science 
courses, and graduate Spanish ins truction ;;r:eceived a superior ra- 
ting. The project continued to strive toward even more excellence 
in 1982 than it had achieved previously, a very high mark indeed. 

The evaluator works with several university programs and evaluates 
three. The East Texas State University program is easily the most 
integrated intc the university system, equals the others in reach- 
ing the target students, and is superior to most in the quality of 
the instruction. The East Texas ^State University ESEA Title VII 
project is an example of federal monies spent wisely and effec- 
tively. The University's efforts and the student needs- cause it 
to be recommended -for continued funding, without reservation. 
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APPENDIX A 
Evaluat9r Resiame 



Earl Jone's , EdD ■ 

--^r- -Jo'nes is a- Senior' Associate with Development Associates ser- 
ving full time' since 1974 in many positions of research, evaluation 
' education, and administration. He concurrently holds the rank of 
professor in bilingual education at Pacific Oaks College and has 
neld professoral and administrative positions with Antioch Univer- 
sity, Incarnate Word College ,. Texas 'A&M University, University of 
Chile, University of California at Los Angeles, Catholic Universify 
of Venezuela, and the Inter -American Institute of the -Organization 
ot- American States, with appointments in both sociology and educa- 
tion. He is currently a member of the California State Adv>"sory 
Committee on Research in Bilingual Education. 

Dr. Jones' primary areas of work with Development Associates have 
included: 

o Research' and /evaluation in bilingual education; 
-o Studies and ^valuations of vocational, preschool, 
university, knd informal education; 
o Prestudies ahd investigations in rural develop- 
ment: education, extension, economics, credit, 
cooperatives!, manpower training and management, 
and socioeconomic ■ factors ; . • ' ■ 

0 General adyisor on. research design , methodologies , 
• data controls, computerization, and analysis, ' ^ 

Since he is fully fluent in Spanish and Portuguese, and directs and 
serves as a researcher and trainer in those languages for the Wo'rld 
Bank, universities, and the company both in the United Stanes and 
in Latin America. He has some knowledge of Arabic, Russian Mag- 
yar, 'and Guaranl. / > ■ > a 

Dr.^ Jones has^long experience in literacy programs, rural schools, 
aT\d studies of them. He was a rural teacher for ten years in Ore- 
gon and California at the beginning of his career. Later he was an 
Organization of American States consultant in general rural -educa- 
tion and literacy programs in Costa Rica (Spanish), Brazil" (P-ortu- 
guese) , Mexico (Spanish), and Paraguay ' (Guaranl , Spanish), helping 
organize the instruction and supervise the Preparation of 'didactic 
materials. In Texas, he helped develop the" earliest Ijilingual pro- 
grams in schools and universities, and served on the Governor's 
Committee for Bilingual Bicultural Education for three years. ^He' 
also wrote and published the first year's bilingual language " arts , 
social studies, and mathematics materials for adult education there. 

Dr. Jones directed the three year study of bilingual education for 
the California Legislature. That impact study tracked 11,000 stu- 
dents' reading, language, and mathematics scores longitudinally. 
The achievement variables were controlled by degree of English pro- 
ficiency, first language, SES, . migrant/special/regular status; ser- 
vices in LI, L2, ESL, other language classes, individualized pro- 
gram; and via classroom observations for exposure to instruction, 
language mix, grouping ■ approach , instructional qualities, and lan- 
guage proficiency of the teachers and aides. Perceived satisfac- 
tion was- measured as an impact variable from older ' students , aides 
teachers , adiilinistrator s , parents, and other community members. To 

^ ' — DEVELOPilEXT ASSOCU.TES, LVC. — 



ERIC 43 



4(3 



\ 



date it is the latest bilingual education impact sutdy .in. the -li- 

_^e^at.ijre..; _„the. stud^ has. enjoyed- the acc'e'ptance oFr and 

practitioners and iS' used as a supplementary text in many univer- 
sity graduate study programs,. 

. Dr. Jones^served as a research consultant and conducted man v-, of .the 

case studies f or • the Development Associates study of th.e_._cXassr.o-om 

instructional components in bilingual education for the US Depart- 
ment of Education; the report is scheduled for release later this 
year. He 'is currently managing the control and conversion of the 
achievement data for the Development Associates contract on Indian 
Education, and advises on the association of ^several pro'gram, stu- 
dent, and social variables with those scores in the analys is ' plan . 
That study is still in progress.' , ' 

Tne researcher was the technical director of the five year study 
of the National- "Ins titute of Education experimental schools program 
in the Edgewood District, San Antonio, Texas. Impact variables of 
attitude, self -concept , motivation, and achievement were collected 
an^^ analyzed, for nearly 5,000 students in that program. .The re- 
search involved detailed examinations of the psychometric proper- 
ties of the Self Concept and Motivation Inventory and the Purdue 
Social Attitude Scales for Primary Children, Nineteen technical 
volumes were issued from the evaluation. 

DiT/' Joues is accomplished in the m'anagement of socioeconomic 'survey 
teams/ Local , multi-disciplinary survey crews vrere formed, trained 
and supervised by him in Costa Rica, Brazil, Do^.inican Republic, 
Jamaica, Ghana ^ and Panama. In two massive studies in Venezuela, 
40 team members conducted a two year regional socioeconomic study 
of the ^entire Bailadores region and a one year effort in the bar- 
rios of Caracas. As director of a recent user preference purvey, 
he supervised the design, instrumentation', and interviewing of many 
surveyors via telephone in several languages. 

Since joining Development- Associates , he has served in the follow- 
ing capacities: 

o Co-Researcher in the evaluation of the Agency for Internation- 
al Development mission in the Dominican Republic efforts in 
private sector development. 

o Co-Researcher in the Title IV Indian education evaluation. 

o Co-Researcher in the Title VII bilingual classroom instruc- 
tion component study. 

o Co-Director of the user preference survey for Pacific Tele- 
phone Company. 

o Co-Res earcher on an evaluative as'sessment of a training and 
technical assistance program for personnel of agricultural 
cooperatives in Honduras and in the formulation of a generic ' 
scope design for AID's projects' in cooperatives. 

o Team Leader for the evaluation of the Food for /eace program 
.in Panama, with work in nutrition, econom.ic factors, and ma- 
nagement of the products ... 
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o Team Leader for the evaluation of tlae Food for Peace, program 
ti. Ghana , 

o Project Director for the three year Icmgitudinal study of 
California ' s educational services .to iXmited and non-Engli-sh 
speaking students for the California Legislature. 



o Hana g em en t"'""C o n s u"l t an t to many western migrant training pra- 

grams for the US Department of Labor, 

o, Educational Consultant to USAID/Guatemala, f\r the design and 
preparation of a project identification description and later 
the project paper for management education in\ Guatemala . 

o Co-Researcher in the evaluation of the services of the bilin- 
•gual service center at .Sari Diego State Universi\y in Califor- 
nia from 1978 to 1982 . 

o Principal Investigator in the evaluation of the Title VII 
bilingual training' program of East Texas State University 
• from 1976 to 1982. ' 

/ o Principal Researcher in the evaluation of ESEA Title Vlj pro- 
grams in school .districts in Elgin, Edcouch-Elsa , McAllen," 
Edgewood (San Antonio), Harlandale (San Antonio), in Texas, 
andv. Redwood City in California. . • 

o ' Co-Researcher on* a project to produce a self evaluation guide ' 
for \nigrant health programs. 

o Technical Director of the National Institute of Education e- 
valuation of the experimental schools program in the Edgewood 
District in San Antonip, Texas. 

' ^ ■ ■ 

In addition,- Dr. Jones has as^sisted many other research and evalu- 
ation programs of the company,, chiefly in the formulation of their 
designs, data -collection and jcontrol systems, and on the analysis 
of data. 

Immediately prior to joining Development Associates, Dr. Jones was ' 
the higher education, consultant to the Mexican American Cultrural 
Center in San Antonio, Texas ^ professor with Antioch University, and 
a member of the President's Commision on Hispanic Affairs. Just be- 
*fore that multiple assignment, he was president of Incarnate Word 
Co.llege in the same city. 

Earlier, he was professor of sociology and education , and associate 
dean of the College of Education at Texas A&i/i University. During 
the five years there he also headed special development programs in 
multicultural and bilingual education, adult and continuing educa- 
tion, vocational projects, and chaired groups for outreach efforts 
in science and technology. He was a full member of the graduate 
faculty. During his tenure there he served three years as Presi-. . 
dent of the Southwest Association for Adult and Continuing Education. 

Dr. Jones was associate professor at the University of California at 
Los Angeles in social psycholagy. He also served in overseas posi- 
tions for that institution as director of the University of Califor- 
nia - University of California Project and concurrehtly held a pro- 
fessoral appointment in sociology at the Univers ity of Chile campus- 
ses in Santiago and Valparaiso. Before that 'assignment he was the 
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UCLA representative to the research work conducted by the La Salle 
Foundation in Venezuela and was professor of sociology, at Catholic 
University Andr^ Bello in Caracas . He directed the socioeconomic 
studies of two regions in Venezuela during that period. 

Formerly, he was assistant professor of sociology and ruraL educa- 
tion at the Inter-American Institute of the Organization of Ameri- 
can States in Turrialba, Costa Rica. In addition to teaching., he 
conducted research ^n every country in the Americas on -short term 
assignment , assisted in the formation of extension and. credit ser- 
vices, and consulted on the reformation of many university an'ci lo- 
cal education services. Before joining the OAS, Dr. Jones had >been 
a vocational and other subjects teacher in high schools in Oregon 
and California; he worked part time as director of farm and other 
special programming for two radio stations in Oregon. 

After nearly four years service with the US Marine Corps in the Pa- 
cific during World War II, Dr. Jones received his baccalaureate in 
agriculture and vocational education from Oregon State University. 
He earned the masters degree in sociology from the Inter-American 
Institute of the OAS, and his doctorate in .social psychology and 
education from Montana State University. He also did special stu- 
dies at the College of Idaho, Stanford University, and the Royal 
Academy of Denmark. He has taught special courses for the Univer- 
'Sity. of Guadalajara, LaVeme University^, the University .of Puertp 
Rico, the World Bank", 'San Antonio College, and Stanford University. 

Dr. Jones has authored and co-authored many books, monographs, ar- 
ticles, and other publications over the years. Chief among these: 

YOUNG, MALCOLM & JONES, EARL. Evaluative assessment of the 1976- 
1977 training and technical assistance project for personnel 
in cooperatives in Honduras. 1982. 

CULBERTSOK, ROBERT; JONES, EARL& CORPEf^O , ROBERTO . -Evaluation of 
USAID/Dominican Republic's projects in private sector develop- 
ment. 1982. " V 

JONES, EARL; ROBLES , IELIODORO; THOMPSON, JOAN & COLEMAN, GEORGE.' 
Ev£iuaci6'n del programa Alimentos para la Pa2:, Titulo II, en 
Panama. 1981. . . 

JONES, E^JIL; ROUSSEL, ROBERT & BERtoWITZ , SARAH.- Evaluation of the 
Title II Food for Peace program in Ghana, 1981. 

JONES, EARi; ROBLES, ELIODORO; MUROZ , ADOLFO & BEPJCOWITZ , SARAH. 

Evaluation of California's services to limited and non-English 
speaking students. 1980. - 

MUnOZ, ADOLFO; WARDLAW, BARRY & JONES, EARL. Self evaluation guide 
for migrant health projects. 1978.^^ 

JONES,- EARL. The 1978-1979 annual report and three year longitudi- 
nal study of the Edgewood Title VII * bilingual program. 1980. 

JONES, EARL. The external evaluation of the Title VII bilingual 
project in the Redwood City Schools. 1980. 1981. 

JONES, EARL. The external evaluation of the ESEA .Title VII bilingual 
training program at East Texas State Universiry. 1976 - 1981. 
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...|0|tL:^S, ELIO'DORO; mmz, ADOLFO- & JONES, EARL. The external evalu- 
a-tion of the Bilingual -Educauion Service Center, San Diego State 
University. 1978 - 1982. 

JONES,. EARL & DAVIS, PETER. Final sunmary report on ihe experimen- 
tal schools project, Edgewood Independent School District. 1977 

JONES, EA.RL. Social attitudes pf South Texas primary children / 1977 

. . BERNAL, HELEN; JONES, EARL & CERVANTES, ROBERT. Psychosocial grav7th 
and achievement of Mexican American students. 1977. 

CERVANTES, ROBERT; BERNAL', HELEN & JON^S, EARL. Educational change: 
case studies in the experimental schools program. 19"77, 

JONES, EARL. An instrumentation study of the Purdue Social Attitude 
Scales for Primary Children, English and Spanish versions. 1976 

JONES, EARL.- An instrumentation study of the Self Concept and Moti- 
vation Inventory, English and Spanish versions. 1976. 

'» . ' ■ 

JONES, EARL. A study of primary pupil performance in language arts 
in the Elgin Independe*3t School District. 1976. * 

JONES, EAPvL. Tne evaluation of the "^Edcouch-Elsa ESEA Title VII bi- 
lingual and special mathematics programs. 1976. 

POTTER, FRANCIS j.; JONES, 'EAPvL 6c CERVANTES , ROBERTA;.. Teacher ■ 
classroom behavio.rs 1976. 

CERVANTES , ^ROBERT A. & JONES, EARL. Locus of control and achieve-' 
ment of Mexican American pupils. 1976. 

SHARP, MICHAEL; CERVANTES, ROBERT & JONES, EARL. A multidimens iohal 
Suudy of self concept of Mexican American students. 1975. 

JONES, EARL (ed.) Latin American literature for youth. 1972. 

JONES, EARi (ed.) 'Perspectives on Latin America. 1971. 

HUBERT, FRANK & JONES, K^RL (eds . ) Introduction to Latin American 
'cultures. 1970. 

JOKES, EARL ET AL . Bailadores: un estudio socioecon6maco de'la re~ 
gi6n de Bailadores , Venezuela. 1966. 

•DI FRAIsiCO, JOSEPH & JON^S , EARL. Evaluation of the agricultural 
extension services in Costa Rica. 1965. 

JONES, EARL ET AL . Lideranpa rural no Brasil. 1963. 

JON^S, EARL ET AL. A study of rural leadership in Bermaddy, Jamai- 
ca. 1962. 

FOOTE, NATH^Js' & JONES, EARL.' El m.undo del barrio en Caracas., Vene- 
zuela. 1962.- 

Earl Jones is listed in many publications Who's Who in the West^ 
Outszar.ding Educators of the South and Soutr^west^ and International 
Biography . He was selected for membership in Phi Kappa Phi and Al- 
pha Zeua honoraries, was Pan American and Kellogg Foundation fellow. 
He received a Standard Oil Foundation. Award for Outstanding Teaching 
and a Presidential Citation from the Government of Guatemala. He is 
a m-ember of the American Academy of Science, American Sociological 
Association, and the American Education Research Association* 

^ V 
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UCLA representative to the research work conducted by the s. SaT l e 
roundation in Venezuela and was professor sociology at CathoUc 
university Andr^ Bello in Caracas. Ke directed the socioeconSSlc 
suudies Oi two regions In Venezuela during that period. • 

Formerly, he was assistant professor of s-ociolosv and ru-a""^ educa- 
tion at tne mter-American Institute of the Organization o-" ^e--; - 
can^States in Turrialba, Costa Rica. In addition to teachinc^ he 
conauctec research in every country in the A.-ericas on . shor t°tenB 
assigninent, assisted in the f oruiation ,of extens ion and credit ser- 
vices, and consulted on the reif ormation of many un-'ve-sitv ■and lo- 
cal education services. Bef or e j oining the OAS , ^ Dr . Jones had been 
^ vocational ana other subjects teacher in high schools in O-egon 
.anc Caiiromia; he worked part time a:~£ director of farm and othe- 
special programming for two radio stations in Oregon., 

After nearly four years service with the US Marine Corps in the Pa- 
ciric during World War II, Dr. Jones received his baccalaureate in 
agriculture_ and vocational education from Oregon State Unive-s'-ty 
He earnec tne niasters degree in sociology from the Inter- American ' 
InsLitu_e or tne OAS, anc nis doctorate in social psvcho'o^v and 
ecucaticn rrom Montana State Universitv. He a"^- did ^--e-ia" c-, 
cies at -he College of .Idaho, Stanford' Univers itv , and^lh- Roya^^"" 
.-.caaemy cr Denmark. Ke has taught special co-jrses fc- the U-'lve-- 
sity cr Guacalajara, LaVeme Universitv, -he Universitv -u---c 
Kico, tne World Bank,- -San Antonic College , and Stanford Universitv. 
■Dr._Jcnes has authored and 'co-authcrec manv bocks . mono^-an'-.c a-- 
tic_es, anc otner publications ever the years . Chief among these: 
YOUN-G, MA.LCdlM JOInES, EaAl . Evaluative assessment q-' t^e 1^75. 

191/ / training and technical assistance prciect for pe-^o-^ne' 

m cooperatives in Honduras. 19S2. " " 



^■-SfjjT??^;- P^OBERT; JONES EARL & COP-Ef^C , ROBERTO. Evaluation of 
oS.-.__;/xJom.inican Republic's projects in private secto- deve-^op- 
ment . 1982 . . " _~ • 

JONES. E/_RL; ROSLES , ELIODORO; THOMPSON, JO.AK COLEM.^.K , GEORGE 
Eva_uaci6n del programa Alimentos para la Paz t< tulo ~~ e-^ 
Panama. 19S1. ' , . -_, i. 

JONES, E/JIL'; ROUSSEL, ROBERT <S.- BERK0WIT2 , S.ARAJ-l , Evaluation of the 
Title II Food for Peace program in Ghana. 1981. 

JONES, E/JJL; ROBLES, ELIODORO; MUR02 , ADOLFC a- BEPJCOWI^^Z SARi^' ■ 
Evaluation of California's services tc limited and non-Enelish 
speaking stucents. 1980.. • , . 



Z ^DOUFO; WAPJDLAW, BARRY d- JONES. EARL. Self evaluation .guide 
for m.igrant neaith projects. 1978. • • 

JONES, E.^JIL. rne 1978-1979 annual report and rhree vea^ lon^itud"?- 
hal study of the Edgewood Title V_I bilingual program,^ 1980.' 

JONES, EARL. Tne external evaluation of the Title VII bilin'^^ua'' 
project in the Redwood City Schools. 1980. 1981? ~ ' "° 

JONES, EARL. Tne external ev^iuation of the ESE.'^. Title VII bi^-^'ncruai 
training program at East Texas State University. 1976 - 1981° 
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..RAM AS Bl UNGUES 
GUAL PROGRAM 



EAST TEXAS STATE UNIVERSITY 



To: 
Re: 



Liaison Report Form 



School Principal 



Total School Enrollment: 
Class visited 



Name of .teacher 



Certified bilingual? 



% Mex^i can-Americans 



Number of students 



Proficiency in the Spanish language: Outstanding 

Good: 



Number of- Spanish dominant students i,n the class 



' Engl i sh dominant 

Total number of Spanish reading groups 

Number of students in each Spanish reading .group 

Total number- of English reading groups 



Very good 

Fair Poor 

^ Bilin^gual 

DtTieF"" 



Number of students in each English reading, group 
Materials used to teach Spanish reading 



-^the^^^^saiJ^ects-taught i n S pa n i s h 




EASTTEXAS STATE UNIVERSITY — Commerce, Texa-s. 75428 
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Amount of time spent each day teaching ESL by: Teacher 

Resource teacher Aide _ 

Materials used to teach ESL: 



Any teaching of SSL? 



Approximate total emount of time .spent each" day teaching in Spanish 



Any team teaching? 



Amount of time bilingual aid spends in the classroom: 



Any parental involvement? 



Teacher's suggestions, questions or special classroom situations: 

I 



Additional comments: 
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E.\ST TEXAS STATE UNIVERSITY - BILINGUAL TRAINING PROGRAM 
INSTRUCTIONAL EVALUATION PROGRAM- - FORM B (PROGRAM EVALUATION) 



/ 



Social Security No. ^ For_^ Semester of 19 

Please complete once for each serr^ester enrolled. 
' What suggestions do you have for improving the following ? (use back or additional sheet 
if necessary) 
J . Language Program 

a. Spanish language 

b. English language 

c. Literature 

H d. Linguistics 

» 

2. Culture Program 

d. . His tprical Aspects 

b. jSocio- Anthropology^ .A,$pect5 

c. Psychological Aspects 
^ 3. Teaching Methodology 

a. Kinds of methods presented 

b. The way the . me,tlxCKiS-_a r„ e_!^^.u 

4. ' R esear ch \ ^ 

a. Methods of doing research ^ 

b. .Ag^lica tions of research methods 

5. Looking at your graduate degre,e progran") as a whole, from what you can tell at 
this point, how would you rate it? \ * 

\ - 

very weak- ^ ^ ^ ^^^V st\ong 



X 



\ 

\ 



\ 



weak ' strong ^ 



\ 
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How. would you rate fluency in Spanish' ai this point in the program? 
a) oral b) wri tten 
■ very fluent very fluent 

fairly fluent fairly fluent . 

_know some Spanish knOw some Spanish ^ 



still know nearly no Spanish still know nearly no £*-.*anish 



7. Please list the kind(s) of information and or technique(s) you obtained this semester 
through the program which have been most useful to you, in your classroom: 



8. H0W would you rate the effectiveness of ihe clinical a ssistance /liaison program 
('school visits) in helping you. 

very effective fairly 'effective ^no app'ortunity or did not use* 

not effective reque.sted but was not scheduled 
^ •/ 

9. How would you rate the usefulness of the consultant presc>-n:a{.:ons at general meetings 

very useful fairly useful not useful 

t- 

I ^{.ended al l some none. 
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EAST TEXAS STATE UNIVERSITY - BILINGUAL TR AINING- PR OGR AM 
INSTRUCTIONAL EVALUATION PROGRAM-FORM A (DEMOGRAPHIC INFORMATION) 



For 



So'^cial Security No. 

Please^complete at conclusion of first semester of enrollmcn: 



Semester of 19 



Present occupation: 

teacher , grades '1-3 
teacher , grades 4- 6 
teacher , grades 7- 8 



teacher, grades 9-12 
Administrator: 



Other (aide, substitute, and any other not 
covered; please specify: < ■ 



Sex: Male 



Female 



'6- 10 years 
1 1 or mor€; 



Total teaching experience: 
Less than 9 months 
1- 2 years 
3- 5 y^ar s 



3. Total bilingual teaching experience.. 

I Less Than 9 months 6-10 years 

; 1-2 years ~ 1 1 or more 

! 3- 5 years 



I 



5. Ethnicity: Mexican Americaii Black Anglo U Other_ 



no 



6. Do you ha ve bilingual education endorsement yes 

7. If yes, endorsement obtained through. . . 

Lo.cal School District Committee 

College or university certification program 

8. When you began'this East Texas State bilinguil graduate program, ho-w fluent Avere 
* you in Spanish? a) Speaking (oral fluency); b) Writing: 

very fluent very fluent 

■ fairly fluan^e fairly fluent 

knew a little Spanish 
~ "knew no Spanish 



knew a little Spanisl 
knew no Spani sh 



9. I gained fluency in Spanish. . . 

at home in the U . S . (e , g . in Texas, N.M. . Ariz. , P.R . etc. ) 

at home outside the U .S. (e.g. in Mexico, Venezuela, etc.) 

through language study in high school 
^ through college/university study 

through TEA (Region 10) languajje institute clusters 
other; 

[0. lam receiving Title Vll^txnding for this program, 

~l am paying my own fees or receiving other thin Title VII funding. 
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E\ST TEXAS STATE UNIVERSITY - BILINGUAL TR AINLNG PROGRAM 
LNSTRUCTIONAL EVALUATION PROGRAM— FORM C (COURSE EVALUATION) . 



Social Security No. 
Please comol 

Course Dept. 



For_ 

Please comolete one foi-ivi for each course. 



N u rri b e r 



S e c t i o ri 



1, How would you rate Lhc coverage of Lhe 
subject matter ? 

^, How would you rate the met!-»ods in 
teaching the course? 

3, How closely were the tests related 
to the materials covt-red? 

4, In so far as you can tell at this point, 
how would you rate the grading systc-n^ 
used in this course? 

5, How would you rate your learning in 
this course ? • • 



Semester of 19 



] 2 3 4 5 

very strong fair weak very 
itrong weak 



4 " 



Taking all factors into consideratiori, 
what would your rating be for this 
course ? 



3 ' 4 ' 





] 


2 


3 


■ 4 


5 




none . 


2 0% 


40% 


60% 


80% 


1 


to 


to 


to 


to 


to 






4 0% 


60% 


80% 

V 


100% 


What percent of the 


time (estimate) did. . . 










d, the professor us 


eSpanishinthe 










course ? . 


1 


2 


3 




5 


b, the students use 


Sp;^nish in the 










course'?^ 




2 


3 


4 


• 5 



0 
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f Prog ra ma s BWi 



u es j 



mm 





E a i 



East Texas State University 



i 





Universidad Estatal del Este de Texas 



2 3 Qctober 1981 



Volume VII, N?1 



C0N6.RESS SETS $139 MILLION CEILING FOR TITLE VII BILINGUAL 



EDUCATION FOR FY '82. '83. 



o4 



A joint House-Senate conference conmittee that^as formed to work out differenceis 
in the massive budget reconciliation package before Congress recommended an author- 
ization ceiling of $139 million for bilingual education programs presently opera^:ing" 
under Title VII of the Elementary and Secondary Education Act. The ceiling, approved 
by the ful 1 . Congress and the President, v,'ill be the maximum amount that may be 
appropriated for Title VII programs each year from fiscal year 1982 to fiscal year 
1984. Congress may,, however , appropriate lesser amounts each year. The figure 
agreed to was more than the House-recommended $85.3 million but less 
recommendation of $163 million for the same three years. Members of 
committee which considered Title VII bilingual education were: Sen. 
(R-Utah), Sen. Dan Quayle (R-Ind.), Sen. Robert T. Stafford (R-Vt.): 



than the . Senate 
the conference 
Orrin G. Hatch . 
, Sen. Edward M. 



Kennedy (D-Mass.), Sen. Claiborne Pell (D-R.I.), and Rep. Carl Perkins (D-Ky.)._ 



ETSUj SUmARY OF 'BILINGUAL STUDENTS ENROLLED & FUf^D 
DISTRIBUTION FROM TITLE VH GRANT FALL SEMESTER- 

Commencing its sixth year of funding under ESEA Title VII Bilingual Education, 
enrollment of students for Fall Semester 81 was a total of 84 with the following 
breakdown. Undergraduate level enrol-lment- was 35. of which, 33 were funded for tui- 
tion and fees. The Graduate level enrollment was 40, of which, only 25 were funded 
for tuition and fees. The Post-master level enrollment was 9, of which, 3 were 
funded far tuition and fees. 

Unfunded applicants that did enroll for Fall semester in graduate level and post- 
master level were 15 and 6, respectively. 

Funds from Title VII Bilingual Education Grant were allocat*ed for the amounts 
indicated as follow: Undergraduate level ;total ... $17,729.86, Graduate level; total 
...$4,091.52, and Post-master level ; total ... $364. 79» Total expenditures for tuition 
and fees, transportation, housing and books (for all levels) was $10,135.25, $2,602.80, 
$5,930.00, and $2,518.22, respectively. 
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THE STATUS OF EDUCATION- FOR HISPANICS 

By Ramon Santiago and Rosa Castro Feinberg ■ \^ 

Educational and economic indicators do not paint an optimistic picture of the conditions 
of Hispanics in the United States. Three years ago, one-fifth of all Hispanic fa^milies 
had incomes below the poverty level, as compared with 9 percent of non-Hispanic families. 
In 1976, Hispanics aged 14-19 were twice as likely as whites^not to, complete high school, 
and at the elementary level about two-thirds v/ere attending schools composed primarily 
of minority students. Of those who entered college in 1972, ov^^r half did not gradi\ate. 

In this article we 'will identify areas of progress and unresolved problems in achieving 
educational equity for Hispanic students. The information summarized' here is based on 
.two sources: the Executive Reports from three of the five Regional Conferences on the^^ 
Education of Hispanics, "held in 1980 under the auspices of the Office of Hispanic Con- ^ 
cerns -and other Department of Education agencies, and presentations delivered at the \ 
. Conference for the Midwest Region, where all 'Hispanic subgroups were represented. Each', 
section concl udes "wi th , a review of recommendations from the Regional Conferences. Un- ,i 
less otherwise noted, statistical data are from the National Center for Educational : Sta- 
tistics (Brown and others, 1980). i 

Ramdn L. Santiago is Director of the Georgetoixn Vniversiti Eili/isy.al Education Service 
Center^ Washington^ D,C. ; and Rosa Cazzro Feinberg is Associate Director of the 
Univ&rsivv of Miami National Origin Desegregation, Assistance Cenzer^ Coral Gabies^ 
Florida. 

ELEMENTARY AND SECONDARY EDUCATION ' ' 

Over 3 million Hispanic children, or 6 percent of the total mainland public school 
population, are enrolled in elementary and secondary schools. Roughly a third of these 
children attend schools in which minority students Comprise 90 to 100 percent of the 
total enrollment, and another third attend schools where the percentage of minority stu- 
dents is between 50-89 percent. Such segregation of Hispanic students is more marked 
in th& Northeast but is increasing rapidly in the Midwest as well. 

Enrollment figures reveal that 57 percent of the three- to six-year-old Hispanic child- 
ren are in- school, compared with 65 percent of whites. Among 8- to 13-year-olds, ap- 

. proximately* 10 percent of Hispanic children are below grade level-double the rate for 
white, non-Hispanic children. This same ratio persists among the 14- to 20-year-olds., 
^5 percent of whom are not at the expected grade levels. In this older age group in- 
creased disadvantage is noted for the four out of five who live' in households where 

^Spanish is' spoken. 

In assessments conducted by the National Assessment of Educational Progress^ (NAEP), 9-, 
13-, and 17-year-old Hispanic students were significantly below the national average 
■ in social studies, science, 'mathematics , career and occupational development, -and ^ . 
reading. Moreover, as they got older their achievement in math, science, ari.d:rsocial ^ 
studies'decreased , though, recent studies have noted a ^mall but statistically signifi- 
. cant improvement by 17-year-olds in science. 

The National' Ce'nter for Educational Statistics concluded, in a national longitudinal 
study of high school seniors begun in 1972, that Hispanic seniors generally receive 
lower grades than their whi te cl assmates , and that Hispanics participate less in extra- 
curricular activities (with the exception of vocational clubs). 

For Hispanics, the dropout rate has . historically and consistently been higher than for 
non-Hispanics. In 1972, 16 percent of Hispanics aged 14 through 19 were, out of school 
A^^nugh not graduated, compared with 8 percent of the corresponding white group. By 1978, 
ErJc '^■'9^^^^ increased to 19 percent for Hispanics and 9 percent for whites. 



